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MEDICAL IMAGE PROCESSING APPARATUS, 
AND MEDICAL IMAGE PROCESSING METHOD 

BACKGROUND OF THE INVENTION 
5 Field of the Invention 

[00001] The present invention relates to a medial image processing 
apparatus and a medical image processing method for generating a three-dimensional 
medical image used in image diagnosis, etc. and particularly relates to a medical 
image processing apparatus, and a medical image processing method suitable for 
10 displaying a tubular tissue such as a vessel. 

Description of the Related Art 
[00002] Conventionally, there has been conducted image diagnosis for 
diagnosing diseases, etc. by acquiring a tomographic (slice) image of an organ, etc. of 
15 a human body using a modality (image acquiring apparatus) such as a CT scanner, an 
MRI apparatus, etc. Further, a method of conducting diagnosis by generating a three- 
dimensional image of a predetermined organ, etc. based on an acquired tomographic 
image has been established, contributing to a precise and accurate diagnosis. 
Especially, diagnosis by a three-dimensional image of a coronary vessel around a 
20 heart is helpful for an early detection of a heart disease. 

[00003] In such three-dimensional image diagnosis, it is often the case that 
an image of an observation target part is extracted from an original three-dimensional 
image and then diagnosed by an observation. However, in general, it was difficult to 
extract an image of an elongated tubular tissue such as a vessel (particularly, a 
25 coronary vessel around a heart) , in the past. 
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[00004] To solve such a problem, a method for an extraction of an image of 
a vessel tissue is disclosed in the Unexamined Japanese Patent Application KOKAI 
Publication No. 2002-282235 (pp. 4-5). According to this document, a "binary mask" 
which separates picture element values indicating a concerned area (i.e. a target vessel 
5 tissue) from picture element values indicating areas other than the concerned area is 
generated. By using this "binary mask", the vessel tissue is distinguished from other 
tissues. The picture element value indicates the gradation of a picture element. 
Further, picture elements include two-dimensional picture elements (pixels) and three- 
dimensional picture elements (voxels). Hereinafter, these will be denoted by "picture 
10 element". 

[00005] In a method using a binary mask described above, once a picture 
element value for indicating a target tissue is set, it is determined whether a given part 
belongs to the target tissue or not based on whether each value of the picture element 
in the area subjected to the determination is the value indicating the target tissue. In 

15 this case, if only the target vessel for the extraction exists in the area subjected to the 
determination, the image of the target vessel can be extracted without any trouble. 
However, in general, other tissues (a vessel, an organ, etc.) exist closely to the target 
vessel. In particular, in a case where the target is a coronary vessel around a heart, the 
heart and many other vessels exist near the coronary vessel. Since the compositional 

20 elements of those close organs are almost the same as those of the target vessel, the 
picture element values indicating the close organs are similar to the picture element 
values indicating the target vessel. Because of this, the target vessel can not be 
extracted accurately by using a method disclosed in the Unexamined Japanese Patent 
Application KOKAI Publication No. H8-89501 (p. 6), for the target vessel can not be 

25 distinguished from the other tissues. 



2 



Atty. Docket No. 60,233-005 

[00006] In a case where a coronary vessel extending from a heart is imaged 
(visualized) based on CT values obtained by an image acquiring apparatus such as a 
CT scanner, the generated image is normally reduced in brightness gradually as the 
coronary vessel extends away from its originating position. That is, it can be said that 
5 approximation is established such that picture element values change generally 
linearly in accordance with the distances from the originating position of the coronary 
vessel. By utilizing this characteristic, usp 6,424,732 discloses a method for 
extracting a target vessel by using a "multi-value mask" which allocates picture 
element values to the vessel by changing the values linearly from the originating 

10 position of the vessel to the extraction end position. However, in a case where a heart 
or other vessels exist closely to the target vessel or in a case where the target vessel 
has an abnormal part, the picture element values indicating the target vessel do not 
change simply linearly. Consequently, if an image is generated by changing picture 
element values simply linearly, the resulting image might be such that the target 

15 vessel and its close organ are combined or the target vessel is discontinuous. 
Therefore, it is difficult to obtain an image that can contribute to an accurate 
diagnosis. 

[00007] A patent document 2 discloses a method of detecting a vessel part 
by detecting the average density around the attention point. However, in a case where 
20 a heart or other vessels exist closely to the target vessel, an effective density value can 
not be obtained. Therefore, this method can not extract the vessel part accurately, 
either. 
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SUMMARY OF THE INVENTION 
[00008] The present invention was made in view of the above circumstance, 
and an object of the present invention is to provide a medical image processing 
apparatus, and a medical image processing method capable of accurately extracting a 
5 tubular tissue such as a vessel. 

[00009] To achieve the above object, a medical image processing apparatus 
according to a first aspect of the present invention is a medical image processing 
apparatus for generating a medical image using three-dimensional volume data 
representing an internal portion of a biological body, and comprises: 
10 [00010] a volume data obtaining unit which obtains predetermined three- 

dimensional volume data including a tubular tissue; 

[00011] a region specifying unit which specifies a region including a 
position on the tubular tissue in the three-dimensional volume data, at each of a 
plurality of such positions; 
15 [00012] an extraction unit which extracts information on the tubular tissue in 

each of the specified regions; and 

[00013] a medical image generating unit which generates a medical image 
representing the tubular tissue, based on the information extracted by said extraction 
unit. 

20 [00014] It is preferred that extraction unit includes: 

[00015] a center specifying unit which specifies a center position of a cross 
section of the tubular tissue in each of the plurality of regions specified by said region 
specifying unit, based on the three-dimensional volume data obtained by the volume 
data obtaining unit; and 
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[00016] a center line specifying unit which specifies a center line of the 
tubular tissue in a longitudinal direction of the tubular tissue, based on the plurality of 
center positions specified by said center specifying unit. 

[00017] It is preferred that said region specifying unit sequentially specifies 
5 regions along the tubular tissue; and 

[00018] said center specifying unit specifies a center of a cross section of the 
tubular tissue in each of the regions sequentially specified by said region specifying 
unit. 

[00019] It is preferred that said region specifying unit specifies a planar 
10 region which orthogonally intersects with the longitudinal direction of the tubular 
tissue; and 

[00020] said center specifying unit specifies a center position of a cross 
section of the tubular tissue in the planar region specified by said region specifying 
unit. 

15 [00021] It is preferred that extraction unit includes: 

[00022] a unit which obtains a median point represented by the three- 
dimensional volume data, of the tubular tissue in each of the plurality of regions 
specified by said region specifying unit; 

[00023] a cross sectional image generation unit which generates a cross 
20 sectional image representing a cross section of the tubular tissue at a position of the 
median point obtained by said unit for obtaining a median point; and 

[00024] a center specifying unit which specifies a center position of the cross 
section in the three-dimensional volume data, based on the generated cross sectional 
image. 
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[00025] It is preferred that further comprising a designation reception unit 
which receives designation for two arbitrary points on the tubular tissue represented 
by the three-dimensional volume data, 

[00026] wherein: 

5 ,[00027] said region specifying unit sequentially specifies planar regions 

which orthogonally intersect with the longitudinal direction of the tubular tissue, at a 
plurality of positions between the two points along the tubular tissue; and 

[00028] said center specifying unit specifies a center of a cross section of the 
tubular tissue in each of the plurality of planar regions specified by said region 
10 specifying unit. 

[00029] It is preferred that said designation reception unit receives 
designation for a planar region which orthogonally intersects with the longitudinal 
direction of the tubular tissue, at one of the two designated points; 

[00030] said region specifying unit sequentially specifies points which are 
15 apart from one another by a predetermined distance in a direction heading from the 
one point to the other point of the two points along the tubular tissue, and sequentially 
specifies planar regions orthogonally intersecting with the longitudinal direction of 
the tubular tissue at each of the specified points; 

[00031] said center specifying unit specifies a center position of a cross 
20 section of the tubular tissue in each of the plurality of planar regions specified by said 
region specifying unit; and 

[00032] said center line specifying unit specifies a center line of the tubular 
tissue in the longitudinal direction of the tubular tissue, based on the plurality of 
center positions specified by said center specifying unit. 
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[00033] It is preferred that the three-dimensional volume data includes three- 
dimensional coordinate information and characteristic information representing a 
characteristic unique to a substance at each position represented by the three- 
dimensional coordinate information; and 
5 [00034] said cross sectional image generation unit generates an image based 

on information representing a three-dimensional coordinate position having the 
characteristic information which satisfies a predetermined condition in the three- 
dimensional volume data, and clarifies the cross section of the tubular tissue in the 
image. 

10 [00035] It is preferred that wherein said imaging unit comprises: 

[00036] a condition changing unit which changes the predetermined 
condition; 

[00037] an image attribute detecting unit which detects an image attribute 
which changes in accordance with changes in the predetermined condition; and 
15 [00038] a clarification determining unit which determines whether or not the 

cross section of the tubular tissue is clarified in an image, based on detected changes 
in the image attribute. 

[00039] It is preferred that the image attribute represents an area of an image 
(image area); 

20 [00040] said image attribute detecting unit detects an image area which 

changes in accordance with changes in the predetermined condition, and detects a 
change in the image area corresponding to the changes in the predetermined 
condition; and 
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[00041] said clarification determining unit determines whether or not the 
cross section of the tubular tissue is clarified, based on the detected change in the 
image area. 

[00042] It is preferred that wherein said clarification determining unit 
5 determines that the cross section of the tubular tissue is clarified in the image, when 
an image appearing in a center of the region including the cross section become fit 
inside the region, and the change in the image area becomes the largest. 

[00043] It is preferred that wherein said region specifying unit determines a 
position of a three-dimensional region to be specified next, based on the three- 
10 dimensional volume data which is specified by said center line specifying unit and 
which represents the center line of the tubular tissue. 

[00044] It is preferred that said center line specifying unit specifies the 
center line of the tubular tissue as three-dimensional path data; and 

[00045] said medical image processing apparatus further comprises an image 
15 generating unit which generates an image representing the tubular tissue based on the 
three-dimensional path data specified by said center line specifying unit. 

[00046] It is preferred that wherein said image generating unit comprises: 

[00047] an image calculating unit which generates plural kinds of images 
each representing the tubular tissue, and calculates relative positional relationships 
20 between the images; and 

[00048] a display control unit which displays the generated plural kinds of 
images all at once on a predetermined display device, and displays positional 
relationships on the displayed images by associating the relations based on the relative 
positional relationships between the images calculated by said image calculating unit. 
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[00049] It is preferred that said region specifying unit specifies a 
predetermined three-dimensional region whose center is an arbitrary point on the 
predetermined tubular tissue represented by the three-dimensional volume data; 

[00050] said medical image processing apparatus further comprises an image 
5 clarifying unit which clarifies a three-dimensional image representing only the 
predetermined tubular tissue in the specified three-dimensional region, by changing 
predetermined characteristic information included in the three-dimensional volume 
data which constitutes a three-dimensional image obtained by data-conversion of said 
imaging unit; and 

10 [00051] said medical image generating unit generates a predetermined 

medical image representing the predetermined tubular tissue, by using the three- 
dimensional image clarified by said image clarifying unit. 

[00052] It is preferred that said image clarifying unit comprises 
[00053] a closed region detecting unit which detects a closed region which 
15 constitutes the three-dimensional image obtained by data-conversion of said imaging 
unit and which includes a center of the three-dimensional region, and 

[00054] a clarification determining unit which determines based on the 
closed region detected by said closed region detecting unit and the three-dimensional 
region whether or not the closed region represents only the predetermined tubular 
20 tissue; and 

[00055] the closed region which is determined by said clarification 
determining unit as representing only the predetermined tubular tissue is regarded as 
the clarified three-dimensional image. 

[00056] It is preferred that said closed region detecting unit detects a change 
25 in the closed region corresponding to changes in the characteristic information; and 
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[00057] said clarification determining unit determines whether or not the 
closed region represents only the predetermined tubular tissue, based on changes in 
the closed region. 

[00058] It is preferred that said region specifying unit specifies a plurality of 
5 three-dimensional regions by setting a center of a three-dimensional region to be 
specified next based on the arbitrary point and/or the clarified three-dimensional 
image; and 

[00059] said medical image generating unit generates the predetermined 
medical image representing the predetermined tubular tissue, by using three- 
10 dimensional images clarified in the plurality of three-dimensional regions. 

[00060] To achieve the above object, a medical image processing method 
according to a second aspect of the present invention is a medical image processing 
method for generating an image representing a tubular tissue in a living body by using 
a computer, said method comprising: 
15 [00061] a step of obtaining predetermined three-dimensional volume data 

including a tubular tissue; 

[00062] a step of specifying a region including a position on the tubular 
tissue in the three-dimensional volume data, at a plurality of such positions; 

[00063] a step of extracting information on the tubular tissue in each of the 
20 plurality of specified regions; and 

[00064] a step of generating a medical image representing the tubular tissue, 
based on the extracted information. 

[00065] It is preferred that said step of extracting information on the tubular 
tissue includes: 
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[00066] a step of specifying a center position of a cross section of the tubular 
tissue in each of the plurality of specified regions; and 

[00067] a step of specifying a center line of the tubular tissue in a 
longitudinal direction of the tubular tissue, based on the plurality of specified center 
5 positions. 

[00068] It is preferred that in said step of specifying a region, regions are 
sequentially specified along the tubular tissue; and 

[00069] In said step of specifying a center position, a center position of a 
cross section of the tubular tissue in each of the regions sequentially specified is 
10 specified. 

[00070] It is preferred that in said step of specifying a region, a planar region 
which orthogonally intersects with the longitudinal direction of the tubular tissue is 
specified; and 

[00071] In said step of specifying a center position, a center position of a 
15 cross section of the tubular tissue in the specified planar region is specified. 

[00072] It is preferred that step of extracting information includes: 

[00073] a step of obtaining a median point of the tubular tissue represented 
by the three-dimensional volume data in each of the plurality of specified regions; 

[00074] a step of generating a cross sectional image representing a cross 
20 section of the tubular tissue at a position of the median point obtained in said step of 
obtaining a median point; and 

[00075] a step of specifying a center position of the cross section in the 
three-dimensional volume data, based on the generated cross sectional image. 
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[00076] It is preferred that further comprising a step of receiving designation 
for two arbitrary points on the tubular tissue represented by the three-dimensional 
volume data, 

[00077] wherein: 

5 [00078] in said step of specifying a region, planar regions orthogonally 

intersecting with the longitudinal direction of the tubular tissue are sequentially 
specified at a plurality of positions between the two points along the tubular tissue; 
and 

[00079] in said step of specifying a center position, a center position of a 
10 cross section of the tubular tissue in each of the plurality of specified planar regions is 
specified. 

[00080] It is preferred that in said step of receiving designation, designation 
for a planar region orthogonally intersecting with the longitudinal direction of the 
tubular tissue at one of the two designated points is received; 

15 [00081] in said step of specifying a region, points apart from one another by 

a predetermined distance are sequentially specified along the tubular tissue in a 
direction heading from the one point to the other point of the two points, and planar 
regions orthogonally intersecting with the longitudinal direction of the tubular tissue 
at the specified points are sequentially specified; 

20 [00082] in said step of specifying a center position, a center position of a 

cross section of the tubular tissue in each of the specified planar regions is specified; 
and 

[00083] in said step of specifying a center line, a center line of the tubular 
tissue in the longitudinal direction of the tubular tissue is specified based on the 
25 specified center positions. 
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[00084] It is preferred that the three-dimensional volume data includes three- 
dimensional coordinate information and characteristic information representing a 
characteristic unique to a substance at each position represented by the three- 
dimensional coordinate information; and 
5 [00085] in said step of generating a cross sectional image, an image is 

generated based on information representing a three-dimensional coordinate position 
having the characteristic information satisfying a predetermined condition in the 
three-dimensional volume data, and the cross section of the tubular tissue is clarified 
in the image. 

10 [00086] It is preferred that said step of generating a cross sectional image 

includes: 

[00087] a step of changing the predetermined condition; 

[00088] a step of detecting an image attribute which changes in accordance 
with changes in the predetermined condition; and 
15 [00089] a step of determining whether or not the cross section of the tubular 

tissue is clarified in an image, based on detected changes in the image attribute. 

[00090] It is preferred that the image attribute represents an area of an image 
(image area); 

[00091] in said step of detecting an image area which changes in accordance 
20 with changes in the predetermined condition, and detects a change in the image area 
corresponding to the changes in the predetermined condition; and 

[00092] in said step of determining whether or not the cross section of the 
tubular tissue is clarified, based on the detected change in the image area. 

[00093] It is preferred that wherein said step of determining that the cross 
25 section of the tubular tissue is clarified in the image, when an image appearing in a 
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center of the region including the cross section become fit inside the region, and the 
change in the image area becomes the largest. 

[00094] It is preferred that said step of determining a position of a three- 
dimensional region to be specified next, based on the three-dimensional volume data 
5 which is specified in said step of specifying the center line of the tubular tissue. 

[00095] It is preferred that said step of specifying the center line of the 
tubular tissue as three-dimensional path data; and 

[00096] said step of generating an image representing the tubular tissue 
based on the three-dimensional path data specified in said step of specifying the 
10 center line of the tubular tissue. 

[00097] It is preferred that said step of generating an image comprises: 

[00098] a step of generating plural kinds of images each representing the 
tubular tissue, and calculates relative positional relationships between the images; and 
a step of displaying the generated plural kinds of images all at once on a 
15 predetermined display device, and displays positional relationships on the displayed 
images by associating the relations based on the relative positional relationships 
between the images calculated in said step of generating plural kinds of images. 

[00099] It is preferred that said step of specifying a predetermined three- 
dimensional region whose center is an arbitrary point on the predetermined tubular 
20 tissue represented by the three-dimensional volume data; 

[000100] said step of clarifying a three-dimensional image representing only 
the predetermined tubular tissue in the specified three-dimensional region, by 
changing predetermined characteristic information included in the three-dimensional 
volume data which constitutes a three-dimensional image obtained by data- 
25 conversion; and 
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[00101] said step of generating a predetermined medical image representing 
the predetermined tubular tissue, by using the three-dimensional image clarified in 
said step of clarifying an image. 

[00102] It is preferred that said step of clarifying an image 
5 [00103] a step of detecting a closed region which constitutes the three- 

dimensional image obtained by data-conversion and which includes a center of the 
three-dimensional region, and 

[00104] a step of determining based on the detected closed region and the 
three-dimensional region whether or not the closed region represents only the 
10 predetermined tubular tissue; and 

[00105] the closed region which is determined as representing only the 
predetermined tubular tissue is regarded as the clarified three-dimensional image. 

[00106] It is preferred that said step of detecting a change in the closed 
region corresponding to changes in the characteristic information; and 
15 [00107] said step of determining whether or not the closed region represents 

only the predetermined tubular tissue, based on changes in the closed region. 

[00108] It is preferred that said step of specifying a plurality of three- 
dimensional regions by setting a center of a three-dimensional region to be specified 
next based on the arbitrary point and/or the clarified three-dimensional image; and 
20 [00109] said step of generating the predetermined medical image 

representing the predetermined tubular tissue, by using three-dimensional images 
clarified in the plurality of three-dimensional regions. 
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BRIEF DESCRIPTION OF THE DRAWINGS 
[000110] These objects and other objects and advantages of the present 
invention will become more apparent upon reading of the following detailed 
description and the accompanying drawings in which: 
5 [000111] FIG. 1 is a diagram exemplarily showing a structure of an "image 

diagnosis system" according to an embodiment of the present invention; 

[000112] FIG. 2 is a block diagram showing a structure of a "control 
terminal" shown in Fig. 1; 

[00113] FIG. 3 is a diagram for explaining a tomographic image (slice) 
10 obtained by the control terminal shown in FIG. 2; 

[00114] FIGS. 4 are diagrams for explaining method for specifying an 
arbitrary region in three-dimensional volume data, where FIG.4A shows an example 
of "MPR" and FIG.4B shows an example of "CPR"; 

[00115] FIG. 5 is a block diagram showing a structure of an "image 
15 processing apparatus" shown in FIG. 1; 

[00116] FIG. 6 is a flowchart for explaining an "image diagnosis process" 
according to an embodiment of the present invention; 

[00117] FIG. 7 is a flowchart for explaining an "image taking process" 
shown in FIG. 6; 

20 [00118] FIG. 8 is a flowchart for explaining a "vessel image extracting 

process" shown in FIG. 6; 

[00119] FIGS. 9 are diagrams for explaining cross sectional regions obtained 
by the vessel image extracting process shown in FIG. 8, where FIG.9A shows an 
example of a cross sectional image displayed for designation of a start point, FIG.9B 

25 exemplarily shows a positional relationship between an obtained cross sectional 
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region and a target vessel, etc. and FIG.9C exemplarily shows a positional 
relationship between an obtained cross sectional region and a cross section of a 
vessel; 

[00120] FIG. 10 is a flowchart for explaining a "marching (advancing, 
5 progressing) direction settling process" in the vessel image extracting process shown 
in FIG. 8; 

[00121] FIGS. 11 are diagrams for explaining parallel cross sectional regions 
specified in the marching (advancing, progressing) direction settling process shown in 
FIG. 10, where FIG.11A exemplarily shows a positional relationship of one of 
10 specified parallel cross sectional regions, FIG.11B exemplarily shows a positional 
relationship of the other of the specified cross sectional regions, and FIG.11C 
exemplarily shows a positional relationship between both of the specified parallel 
cross sectional regions and a orthogonal cross sectional region; 

[00122] FIGS. 12 are diagrams showing examples of longitudinal direction 
15 images obtained in the marching (advancing, progressing) direction settling process 
. shown in FIG. 10, where FIG.12A shows an example of a longitudinal direction 
image obtained in the one parallel cross sectional region, and FIG.12B shows an 
example of a longitudinal direction image obtained in the other parallel cross sectional 
region; 

20 [00123] FIG. 13 is a diagram showing examples of formulae used for 

calculating a vector in the marching (advancing, progressing) direction settling 
process shown in FIG. 10; 

[00124] FIGS. 14 are diagrams for explaining a process included in the 
marching (advancing, progressing) direction settling process shown in FIG. 10, where 

25 FIG.14A exemplarily shows a relationship between a temporary marching 
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(advancing, progressing) direction and a settled marching (advancing, progressing) 
direction, and FIG.14B exemplarily shows an orthogonal cross sectional region which 
is specified based on the settled marching (advancing, progressing) direction; 

[00125] FIGS. 15 are diagrams exemplarily showing a positional 
5 relationship of a target vessel, where FIG.15A exemplarily shows a positional 
relationship between orthogonal cross sectional regions specified for a target vessel, 
and a heart and another vessel which are close to the target vessel, FIG.15B 
exemplarily shows a positional relationship between the target vessel and the heart in 
one orthogonal cross sectional region shown in FIG. 15 A, and FIG.15C exemplarily 

10 shows a positional relationship between the target vessel and the another vessel in the 
other orthogonal cross sectional region shown in FIG. 15 A; 

[00126] FIGS. 16 are diagrams exemplarily showing examples of converted 
data obtained by data-converting the orthogonal cross sectional regions shown in 
FIGS. 15, where FIG.16A shows an example of the image of the region shown in 

15 FIG. 15B, and FIG.16B shows an example of the image of the region shown in FIG. 
15C; 

[00127] FIG. 17 is a flowchart for explaining a "vessel center detecting 
process" according to an embodiment of the present invention; 

[00128] FIGS. 18 are diagrams for explaining the vessel center detecting 
20 process shown in FIG. 17, where FIG. 18 A shows an example of a image when a 
minimum threshold is set, and FIG.18B shows a graph showing picture element 
distribution in a predetermined one-dimensional range when the minimum threshold 
is set; 

[00129] FIGS. 19 are diagrams for explaining the vessel center detecting 
25 process shown in FIG. 17, where FIG.19A is a diagram for explaining a term "unit 
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image", and FIG.19B is a diagram for explaining terms "center unit image" and 
"range of unit image"; 

[00130] FIG. 20 is a diagram showing an example of a "threshold attribute 
table" generated in the vessel center detecting process shown in FIG. 17; 
5 [00131] FIG. 21 is a flowchart for explaining a "cross section clarifying 

process" according to an embodiment of the present invention; 

[00132] FIG. 22 is a graph showing changes in the area of a center unit 
image, which is detected in the cross section clarifying process shown in FIG. 21; 

[00133] FIGS. 23 are diagrams for explaining change of an image in the 
10 cross section clarifying process shown in FIG. 21, where FIG.23A shows an example 
of a case where a center unit image extends beyond an orthogonal cross sectional 
region, and FIG.23B is a graph showing relationship between threshold and picture 
element distribution in this case; 

[00134] FIGS. 24 are diagrams for explaining change of an image in the 
15 cross section clarifying process shown in FIG. 21, where FIG.24A shows a case 
where a center unit image is fit inside an orthogonal cross sectional region, and 
FIG.24B is a graph showing relationship between threshold and picture element 
distribution in this case; 

[00135] FIGS. 25 are diagrams for explaining change of an image in the 
20 cross section clarifying process shown in FIG. 21, where FIG. 25 A shows a case 
where a center unit image includes cross sections of both of a target vessel and 
another vessel, and FIG.25B is a graph showing relationship between threshold and 
picture element distribution in this case; 

[00136] FIGS. 26 are diagrams for explaining change of an image in the 
25 cross section clarifying process shown in FIG. 21, where FTG.26A shows an example 
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of a center unit image when a cross section of a target vessel is clarified, and FIG.26B 
is a graph showing relationship between threshold and picture element distribution in 
this case; 

[00137] FIG. 27 is a diagram exemplarily showing a three-dimensional path 
5 obtained in the cross section clarifying process shown in FIG. 21; 

[00138] FIG. 28 is a diagram showing an example of a three-dimensional 
image generated in a "medical image generating/outputting process" shown in FIG. 6; 

[00139] FIG. 29 is a diagram showing a display example of images 
generated in the "medical image generating/outputting process" shown in FIG. 6; 
10 [00140] FIG. 30 is a flowchart for explaining a "vessel image extracting 

process" shown in FIG. 6; 

[00141] FIGS. 31 are diagrams for explaining a process included in the 
"vessel image extracting process" shown in FIG. 30, where FIG.31A shows an 
example of a two-dimensional image displayed for designation of a start point, and 
15 FIG. 3 IB exemplarily shows a positional relationship between a designated start point 
and end point and a target vessel; 

[00142] FIGS. 32 are diagrams for explaining a process included in the 
"vessel image extracting process" shown in FIG. 30, where FIG.32A is a diagram for 
explaining a positional relationship between a designated start point and a spatial 
20 region to be specified, and FIG.32B is a diagram showing an example of a unit vessel 
image extracted from the specified spatial region; 

[00143] FIG. 33 is a flowchart for explaining a "unit vessel image generating 
process" performed in the "vessel image extracting process" shown in FIG. 30; 
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[00144] FIG. 34 is a diagram for explaining a positional relationship 
between a target vessel and a heart and another vessel which are close to the target 
vessel; 

[00145] FIGS. 35 are diagrams for explaining an example of a case where a 
5 target vessel and a heart are close to each other, where FIG.35A shows an example of 
a positional relationship among a target vessel, a heart close to the target vessel, and a 
spatial region to be specified, and FIG.35B shows an example of a three-dimensional 
image when this spatial region is converted; 

[00146] FIG. 36 is a flowchart for explaining a "vessel image clarifying 
10 process" performed in the "unit vessel image generating process" shown in FIG. 33; 

[00147] FIG. 37 is a graph showing changes in the volume of a continuous 
region in accordance with changes in threshold in the "vessel image clarifying 
process" shown in FIG. 36; 

[00148] FIGS. 38 are diagrams for explaining changes in the volume of a 
15 continuous region appearing in the graph shown in FIG. 37, where FIG.38A shows an 
example of a continuous region when the number of a contact points at which the 
continuous region and a spatial region contact decreases, FIG.38B shows an example 
of the continuous region when the volume of the continuous region is decreasing, and 
FIG.38C shows an example of the continuous region when the continuous region is 
20 separated; 

[00149] FIGS. 39 are diagrams for explaining a "next center position 
determining process" in the "vessel image extracting process" shown in FIG. 30, 
where FIG.39A is an exemplary diagram for explaining a case where an end of a unit 
vessel image is determined as the next center, and FIG.39B is an exemplary diagram 
25 for explaining a case where a midpoint between an end of a unit vessel image and a 
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former center is determined as the next center; 

[00150] FIGS. 40 are diagrams for explaining a case where a "three- 
dimensional region" is used for specifying a cross sectional region according to an 
embodiment of the present invention, where FIG.40A shows an example of a 
5 positional relationship between an arbitrary point on a target vessel and a cubic region 
to be specified, and FIG.40B shows an example of a cross sectional region in the 
specified cubic region and an example of an obtained unit path; 

[00151] FIGS. 41 are diagrams for explaining a method of sequentially 
specifying a cubic region shown in FIGS. 40, where FIG.41A exemplarily shows an 
10 example where an end of a unit path is the median point of the next cubic region, and 
FIG.41B exemplarily shows an example where a midpoint of unit path is the median 
point of the next cubic region; 

[00152] FIGS. 42 are diagrams for explaining another method of specifying 
a cubic region shown in FIGS. 40, where FIG.42A shows an example of a positional 
15 relationship between an arbitrary point n a target vessel and a cubic region to be 
specified, and FIG.42B shows an example of a cross sectional region in the specified 
cubic region and an example of an obtained unit path; 

[00153] FIGS. 43 are diagrams showing other examples of the three- 
dimensional region shown in FIGS. 40, where FIG.43A shows a spatial region having 
20 a rectangular parallelepiped shape, and FIG.43B shows a spatial region having a 
triangular pyramid shape; and 

[00154] FIGS. 44 are diagrams showing other examples of the three- 
dimensional region shown in FIGS. 40, where FIG.44A shows a spatial region having 
a sphere shape, and FIG.44B shows a spatial region having a circular cylinder shape. 

25 
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DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT 
[000155] An embodiment of the present invention will now be explained with 
reference to the drawings. In the embodiment to be described below, explanation will 
be made by taking a case where the present invention is applied to three-dimensional 
5 image diagnosis in a predetermined medical facility (hereinafter referred to as 
"medical facility H") as an example. 

[000156] FIG. 1 is a diagram showing a structure of an image diagnosis 
system according to an embodiment of the present invention. As shown in FIG. 1, the 
image diagnosis system 1 according to the present embodiment comprises a 
10 communication network 10, a modality 100, a control terminal 200, and an image 
processing apparatus 300. 

[00157] The communication network 10 is a communication network that 
mutually connects the control terminal 200 and the image processing apparatus 300 in 
the medical facility H, and intermediates information transmission between them. 
15 The communication network 10 intermediates information transmission which is 
based on a predetermined communication protocol, such as DICOM (Digital Imaging 
and Communications in Medicine). 

[00158] Next, the modality 100 will be explained. The modality 100 is an 
image acquiring apparatus for acquiring an image of the inside of a human body, and 
20 may be, for example, a CT scanner (Computerized Tomography apparatus), a helical 
CT, an MRI (Magnetic Resonance Imaging apparatus), a PET (Positron Emission 
Tomography apparatus), etc. In the present embodiment, a CT scanner for acquiring a 
tomographic image of the inside of a human body using X-rays is employed as the 
modality 100. 
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[00159] According to the present embodiment, the modality 100 (CT 
scanner) is controlled by the control terminal 200 to be described later, and acquires a 
tomographic (slice) image of the inside (inside of a biological body) of a patient or a 
medical examinee (hereinafter referred to as "medical examinee, etc.")- Since in the 
5 present embodiment, a CT scanner is employed as the modality 100, information 
representing a tomographic image includes CT values which are X-ray absorption 
factors. The modality 100 and the control terminal 200 are connected to each other 
based on a predetermined medical image communication standard such as DICOM 
(Digital Imaging and Communications in Medicine). 

10 [00160] Next, the control terminal 200 will be explained. The control 

terminal 200 is constituted by a predetermined information processing apparatus such 
as a workstation. The control terminal 200 controls the operation of the modality 100 
connected thereto, and receives acquired image data (original data) obtained by image 
acquiring by the modality 100. The structure of the control terminal 200 will be 

15 explained with reference to FIG. 2. 

[00161] FIG. 2 is a block diagram showing the structure of the control 
terminal 200. As shown in FIG. 2, the control terminal 200 comprises a control unit 
210, a communication control unit 220, an input control unit 230, an output control 
unit 240, a program storage unit 250, and a storage unit 260. 

20 [00162] The control unit 210 is constituted by, for example, a CPU (Central 

Processing Unit) and a predetermined storage device (RAM (Random Access 
Memory) or the like) that serves as a work area. The control unit 210 controls each 
unit of the control terminal 200, and executes each process to be described below 
based on a predetermined operational program stored in the program storage unit 250. 
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[00163] The communication control unit 220 is constituted by, for example, 
a predetermined communication device such as a predetermined NIC (Network 
Interface Card). The communication control unit 220 connects the control terminal 
200 to the modality 100 and the communication network 10, for performing 
5 communications with the modality 100 and the image processing apparatus 300. 

[00164] The input control unit 230 is connected to a predetermined input 
device 23 such as, for example, a keyboard and a pointing device, etc. The input 
control unit 230 receives instructions, etc. to the control unit 210 which is input from 
the input device 23, and transmits the received instructions to the control unit 210. 
10 [00165] The output control unit 240 is connected to a predetermined output 

device 24 such as, for example, a display device, a printer, etc. The output control 
unit 240 outputs a process result of the control unit 210 to the output device 24 if 
necessity arises. 

[00166] The program storage unit 250 is constituted by a predetermined 
15 storage device such as a hard disk device, a ROM (Read Only Memory), etc. The 
program storage unit 250 stores various operational programs executed by the control 
unit 210. The program storage unit 250 stores an arbitrary OS (Operating System) 
that controls the basic operation of the control terminal 200, and operational programs 
shown in the following (1) and (2) for realizing each process to be described below in 
20 cooperation with the OS. The processes to be described below which are performed 
by the control terminal 200 are realized by the control unit 210 executing these 
operational programs. 

[00167] "Modality control program": a program for controlling the modality 

100 
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[00168] Communication program": a program for controlling the 
communication control unit 220 and performing communications with the modality 
100 and communications via the communication network 10. 

[00169] The storage unit 260 is constituted by a storage device such as a 
5 RAM (Random Access Memory), a hard disk device, etc. The storage unit 260 stores 
acquired image data obtained from the modality 100, etc. 

[00170] "Acquired image data" (original data) obtained from the modality 
100 is "three-dimensional volume data" representing an image-acquired area. The 
three-dimensional volume data contains coordinate information of the area and 

10 characteristic information of each coordinate position. "Characteristic information" is 
information representing, when used in generating an image, characteristics (for 
example, brightness, chromaticness, color scheme, etc.) of picture elements (pixels, 
voxels) composing the image. Since in the present embodiment, a "CT scanner" is 
used as the modality 100, "CT values" are used as the characteristic information. "CT 

15 values" are values representing X-ray absorption factors. When an image is generated 
by using the CT values as picture element values, differences in the CT values are 
expressed as differences in the brightness in the image. Accordingly, by using 
"acquired image data" obtained from the modality 100, a tomographic image (slice 
image) shown in FIG. 3 can be acquired. 

20 [00171] This tomographic image can be seen as a plurality of stacked two- 

dimensional images which are parallel, as shown in FIG. 3. This tomographic image 
can also be seen as a three-dimensional image wherein these stacked two-dimensional 
images are combined. That is, not only each of the stacked two-dimensional images 
can be extracted, but also an image of an arbitrary area or a plane can be designated 

25 from the entire three-dimensional image. A method called MPR (Multi Planer 
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Reconstruction) has been known as a method of designating an arbitrary plane. 
According to this method, an arbitrary plane in the three-dimensional volume data can 
be designated, as shown in FIG. 4A. Further, a method called CPR (Curved Planer 
Reconstruction) has been known as a method of designating an arbitrary curved plane. 
5 According to this method, an arbitrary curved plane in the three-dimensional volume 
data can be designated, as shown in FIG. 4B. 

[00172] The image processing apparatus 300 will be explained next. The 
image processing apparatus 300 is constituted by a predetermined information 
processing apparatus such as a workstation. The image processing apparatus 300 
10 generates a three-dimensional diagnosis image (medical image) by using acquired 
image data (three-dimensional volume data) obtained from the control terminal 200. 
The structure of the image processing apparatus 300 will be explained with reference 
to FIG. 5. 

[00173] FIG. 5 is a block diagram showing the structure of the image 
15 processing apparatus 300. As shown in FIG. 5, the image processing apparatus 300 
comprises a control unit 310, a communication control unit 320, an input control unit 
330, an output control unit 340, a program storage unit 350, and an image storage unit 
360. 

[00174] The control unit 310 is constituted by, for example, a CPU (Central 
20 Processing Unit) and a predetermined storage device (RAM (Random Access 
Memory), etc.) used as a work area. The control unit 310 controls each unit of the 
image processing apparatus 300, and performs each process to be described below 
based on predetermined operational programs stored in the program storage unit 350. 

[00175] The communication control unit 320 is constituted by a 
25 predetermined communication device such as a predetermined NIC (Network 
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Interface Card). The communication control unit 320 connects the image processing 
apparatus 300 to the communication network 10, for performing communications 
with the control terminal 200, etc. 

[00176] The input control unit 330 is connected to a predetermined input 
5 device 33 such as, for example, a keyboard, a pointing device, etc. The input control 
unit 330 receives instructions to the control unit 310, information to be stored in each 
database, etc which are input from the input device 33, and transmits them to the 
control unit 310. 

[00177] The output control unit 340 is connected to a predetermined output 
10 device 34 such as, for example, a display device, a printer, etc. The output control 
unit 340 outputs a process result of the control unit 310, etc. to the output device 34 in 
accordance with necessity. 

[00178] The program storage unit 350 is constituted by a predetermined 
storage device such as a hard disk device, a ROM (Read Only Memory), etc. The 
15 program storage unit 350 stores various operational programs executed by the control 
unit 310. The operational programs stored in the program storage unit 350 includes, 
other than an arbitrary OS (Operating System) that controls the basic operation of the 
image processing apparatus 300, operational programs shown in the following (1) to 
(3) for realizing each process to be described below in cooperation with the OS. The 
20 processes to be described below which are performed by the image processing 
apparatus 300 are realized by the control unit 310 executing these operational 
programs. 

[00179] "Communication program": a program for controlling the 
communication control unit 320 and performing communications with the control 
25 terminal 200 via the communication network 10 
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[00180] "DB control program": a program for controlling the image storage 
unit 360 

[00181] "Image processing program": a program for applying image 
processing to acquired image data obtained from the control terminal 200 
5 [00182] The image storage unit 360 is constituted by a rewritable storage 

device such as, for example, a semiconductor storage device, a hard disk device, etc. 
The image storage unit 360 stores data acquired from each process to be described 
below and three-dimensional diagnosis image to be generated in each process to be 
described below. 

10 [00183] Each process in the present embodiment will now be explained with 

reference to the drawings. In the present embodiment, an image diagnosis system 1 to 
which the present invention is applied will generate a medical image to be used in 
image diagnosis, by extracting only a desired vessel (a vessel to be medically 
examined, diagnosed, or observed, and referred to as "target vessel" hereinafter) from 

15 three-dimensional volume data acquired by the modality 100. 

[00184] FIG. 6 is a flowchart for explaining an "image diagnosis process" 
for conducting image diagnosis by the image diagnosis system 1 to which the present 
invention is applied. As shown in FIG. 6, for the image diagnosis system 1 to 
perform image diagnosis, an "image acquiring process" (step S100), a "vessel image 

20 extracting process" (step S300), and a "medical image generating/outputting process" 
(step S500) will be sequentially performed. The detail of each of these processes will 
now be explained with reference to the drawings. 

[00185] The "image acquiring process" according to the present embodiment 
will first be explained with reference to a flowchart in FIG. 7. This process is for 

25 acquiring a tomographic image (slice) of the inside of a medical examinee, etc. by 
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cooperation of the modality 100 and the control terminal 200. The operation of the 
control terminal 200 will be mainly explained below. The control terminal 200 
performs the following process by executing the "modality control program" in the 
program storage unit 250. 
5 [00186] In performing the image acquiring operation, predetermined image 

acquiring condition information is set at the control terminal 200 (step S101). In this 
step, various conditions for image acquiring, such as designation of an image 
acquiring target area, use or non-use of a contrast medium, etc. are set. 

[00187] The control terminal 200 controls the modality 100 in accordance 

10 with the image acquiring conditions set in step S101 (step S102). That is, the 
modality 100 performs an image acquiring operation based on the above image 
acquiring conditions under the control of the control terminal 200. As a result, the 
modality 100 obtains acquired image data (three-dimensional volume data) of the set 
image acquiring target area. 

15 [00188] When the image acquiring operation of the modality 100 is 

completed, the control terminal 200 receives the obtained acquired image data from 
the modality 100 (step S103). Then, the control terminal 200 stores the received 
acquired image data in the storage unit 260 (step S104), and finishes this process. 

[00189] In the "image diagnosis process" (FIG. 6) according to the present 

20 embodiment, the "vessel image extracting process" for generating a three-dimensional 
image representing a vessel is performed by using the thusly obtained data (three- 
dimensional volume data). This "vessel image extracting process" employs roughly 
two process methods, namely (1) a vessel center line extracting method, and (2) a 
continuous region specifying method. These methods will be referred to as "first 

25 process method" and "second process method". The vessel image extracting process 
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using each of the methods, and the medical image generating/outputting process will 
now be sequentially explained. The processes to be described below are performed 
by the control unit 310 of the image processing apparatus 300 executing the "image 
processing program" in the program storage unit 350. 
5 [00190] (First Process Method) 

[00191] The vessel image extracting process employing the vessel center 
line extracting method will be explained with reference to a flowchart shown in FIG. 
8. In this process, the center line of a desired vessel is extracted as three-dimensional 
path data by using the acquired image data obtained in the "image acquiring process". 

10 In the present embodiment, explanation will be made by employing a case where a 
coronary vessel around a heart is the target of extraction as an example. 

[00192] First, the image processing apparatus 300 obtains the process target 
acquired image data (three dimensional volume data) from the control terminal 200 
via the communication network 10 (step S301). 

15 [00193] Then, the control unit 310 displays a two-dimensional image based 

on the acquired image data (three-dimensional volume data) obtained in step S301 on 
the output device 34 (display device). The control unit 310 receives designation of an 
extraction start point and extraction end point of the extraction target vessel 
(hereinafter referred to as "target vessel Vt") (step S302). Here, an operator such as a 

20 doctor operates the input device 33 and designates the extraction start point and 
extraction end point on the displayed two-dimensional image. 

[00194] FIG. 9A shows an example of the two-dimensional image displayed 
in this step. An image representing an arbitrary two-dimensional plane in the image- 
acquired area that is obtained by the above mentioned MPR or the like is displayed on 

25 the output device 34. That is, the corresponding area is imaged (turned into an image) 
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by expressing darkness and brightness based on the differences in the CT values 
included in the three-dimensional volume data. The image processing apparatus 300 
arbitrarily changes the display such that the position or angle of display is changed, by 
data-converting the three-dimensional volume data corresponding to a position or 
5 direction designated by the operator by operating the input device 33. In a case where 
a vessel is the target of image acquiring, a contrast medium is usually used to raise the 
CT values of the blood. Due to this, the vessel portion is displayed relatively brightly, 
as shown in FIG. 9A. The operator operates the input device 33 and changes the 
display screen so that a cross sectional view of the target vessel Vt at the extraction 
10 start point will be displayed. The operator designates the center of the displayed cross 
sectional view (the center will hereinafter be referred to as "start point SP"), by using 
the input device 33. Further, the operator likewise designates the center of a cross 
sectional view at the extraction end point (the center will hereinafter be referred to as 
"end point EP"). 

15 [00195] When the start point SP is designated in step S302, the control unit 

310 of the image processing apparatus 300 specifies the three-dimensional 
coordinates (x, y, z) of the start point SP. Then, the control unit 310 specifies a region 
(surface) (hereinafter referred to as "orthogonal cross sectional region SR) in whose 
center the start point SP is positioned and which is orthogonal to the longitudinal 

20 direction of the target vessel Vt passing through this center position, based on the 
specified coordinates (step S303). This orthogonal cross sectional region SR is a 
quadrilateral plane which has a certain width and a certain length. An operator 
designates the orientation of the orthogonal cross sectional region to be orthogonal to 
the vessel Vt. 
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[00196] FIG. 9B and FIG. 9C show examples of the positional relationship 
among the points designated in step S302, the target vessel Vt, and the orthogonal 
cross sectional region SR specified in step S303. FIG. 9B is a diagram exemplarily 
showing the positional relationship among the target vessel Vt, the designated start 
5 point SP and end point EP, and an orthogonal cross sectional region SR_0 specified at 
the start point SP. FIG. 9C is an exemplary diagram showing the position of the 
target vessel Vt in the orthogonal cross sectional region SR_0. When the start point 
SP and end point EP are designated on the target vessel Vt (FIG. 9B), the orthogonal 
cross sectional region SR_0 in whose center the start point SP is positioned is 

10 specified (FIG. 9C). 

[00197] In the present embodiment, the orthogonal cross sectional region SR 
is sequentially specified from the start point SP to the end point EP, by a later- 
described process. Accordingly, the orthogonal cross sectional region specified at the 
position of the start point SP will hereinafter be referred to as "orthogonal cross 

15 sectional region SR_0", and the orthogonal cross sectional region specified at the 
position of the end point EP will hereinafter be referred to as "orthogonal cross 
sectional region SR_n". That is, the orthogonal cross sectional regions SR_0 to SR_n 
will be sequentially specified in the process to be described later. 

[00198] The control unit 310 retains the coordinates of the start point SP and 

20 end point EP designated in step S302 in a predetermined storage area such as a work 
area. After this, the control unit 310 determines in which direction the target vessel 
Vt is to be extracted, based on the positions of the start point SP and end point EP. 
Then, the control unit 310 determines which surface of the orthogonal cross sectional 
region SR_0 is the surface at the marching (advancing, progressing) direction side 

25 (hereinafter referred to as "principal surface"), based on the determined direction 
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(marching (advancing, progressing) direction). The control unit 310 determines a 
direction that is perpendicular to the determined principal surface and almost 
coincides with the direction in which the determined principal surface is oriented as a 
"temporary marching (advancing, progressing) direction" DirA (step S304). The 
5 temporary marching (advancing, progressing) direction is determined by the 
following process for each of the orthogonal cross sectional regions SR_0 to SR_n. 
Accordingly, temporary marching (advancing, progressing) directions respectively 
corresponding to the orthogonal cross sectional regions SR_0 to SR_n will be 
represented as "temporary marching (advancing, progressing) directions DirA_0 to 

10 DirA_n" in the following explanation. 

[00199] The temporary marching (advancing, progressing) direction DirA_0 
shown in FIG. 9B is determined in step S304. 

[00200] When the temporary marching (advancing, progressing) direction is 
determined, the control unit 310 performs a "marching (advancing, progressing) 

15 direction settling process" (step S320) for determining the position for specifying the 
orthogonal cross sectional region SR to be specified next (here, an orthogonal cross 
sectional region SR_1 which is an area next to the orthogonal cross sectional region 
SR_0 based on the determined temporary marching (advancing, progressing) 
direction. This "marching (advancing, progressing) direction settling process" will be 

20 explained with reference to a flowchart shown in FIG. 10. 

[00201] By regarding the start point SP designated in step S302 as an origin, 
the control unit 310 specifies two certain-sized quadrilateral regions parallel with the 
temporary marching (advancing, progressing) direction (here, the temporary marching 
(advancing, progressing) direction DirA_0) and each including a cross sectional 

25 surface of the longitudinal direction of the target vessel Vt obtained at the origin 



34 



Atty. Docket No. 60,233-005 

position (hereinafter, one region will be referred to as "parallel cross sectional region 
PR1" and the other "parallel cross sectional region PR2) (step S321). In the present 
embodiment, each time the orthogonal cross sectional region SR is sequentially 
specified, the parallel cross sectional regions PR1 and PR2 are specified. 
5 Accordingly, the parallel cross sectional regions respectively corresponding to the 
orthogonal cross sectional regions SR_0 to SR_n will be represented as "parallel cross 
sectional regions PR1_0 to PRl_n" and "parallel cross sectional regions PR2_0 to 
PR2_n". FIGS. 11 exemplarily show the positional relationships of the parallel cross 
sectional regions PR1_0 and PR2J3. 

10 [00202] FIG. 11A exemplarily shows the positional relationship among the 

parallel cross sectional region PR1_0, the orthogonal cross sectional region SRJ3, and 
the start point SP. FIG. 11B exemplarily shows the positional relationship among the 
parallel cross sectional region PR2_0, the orthogonal cross sectional region SR_0, and 
the start point SP. FIG. 11C and FIG. 11D exemplarily shows the positional 

15 relationship among the orthogonal cross sectional region SR_J), and the parallel cross 
sectional regions PR1_0 and PR2_0. FIG.11C is a diagram seen from a direction 
perpendicular to the vessel Vt. FIG. 1 ID is a diagram seen from a direction parallel to 
the vessel Vt. 

[00203] The temporary marching (advancing, progressing) direction DirA_0 
20 is a direction perpendicular to the principal surface of the orthogonal cross sectional 
region SR_0. Therefore, the parallel cross sectional regions PR1J) and PR2_0 are 
also perpendicular to the principal surface of the orthogonal cross sectional region 
SR_0, as shown in FIGS. 11A to 11D. Further, the control unit 310 specifies the 
regions such that the parallel cross sectional regions PR1J) and PR2_0 are 
25 perpendicular to each other. In addition, the control unit 310 specifies the parallel 
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cross sectional regions PR1__0 and PR2_0 such that they contact the principal surface 
of the orthogonal cross sectional region SR_0, and their contacting sides are on the 
start point SP. Due to this, each of the parallel cross sectional regions PR1_0 and 
PR2_0 includes a cross sectional surface of the longitudinal direction of the target 
5 vessel Vr fit inside its region. 

[00204] The control unit 310 images the specified parallel cross sectional 
regions PR1_0 and PR2_0 by using the volume data representing these regions (step 
S322). That is, the control unit 310 acquires (generates) such images as shown in 
FIGS. 12A and 12B representing cross sectional surfaces of the longitudinal direction 
10 of the target vessel Vt (hereinafter referred to as "longitudinal direction cross 
sectional images"). 

[00205] If it is assumed that the target vessel Vt extends linearly, image data 
of the vessel can be extracted by processing the image data along the temporary 
marching (advancing, progressing) direction DirA which is perpendicular to the 

15 principal surface of the orthogonal cross sectional region SR. However, since the 
vessel extends by changing its extending direction three-dimensionally, the 
longitudinal direction cross sectional image to be acquired is not necessarily parallel 
with the temporary marching (advancing, progressing) direction DirA_0, as shown in 
FIG. 12A. Thus, the control unit 310 corrects the temporary marching (advancing, 

20 progressing) direction DirA_0 to the actual extending direction of the vessel Vt based 
on the acquired longitudinal direction cross sectional image. 

[00206] First, the control unit 310 obtains center positions of the respective 
longitudinal direction cross sectional images acquired in step S322 (step S323). That 
is, the control unit 310 calculates the positions of centers C1_0 and C2_0 shown in 

25 FIGS 12A and 12B. The control unit 310 recognizes (determines) the longitudinal 
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direction cross sectional image region (regions shown in FIG.12A and FIG.12B by 
hatching) of the vessel in the respective parallel cross sectional regions PR1_0 and 
PR2_0 by using "Flood Fill" method or the like, and obtains the centers C1_0 and 
C2_0 of the respective longitudinal direction cross sectional images. Since the center 
5 position is obtained at each of the parallel cross sectional regions PR1_0 to PRl_n 
and parallel cross sectional regions PR2_0 to PR2_n in the following process, the 
centers respectively corresponding to the parallel cross sectional regions PR1_0 to 
PRl_n and parallel cross sectional regions PR2_0 to PR2_n will be represented as 
"centers C1_0 to Cl_n" and "centers C2_0 to C2_n". 
10 [00207] Next, the control unit 310 obtains a "vector of the actual extending 

direction" that represents the direction of the extension of the vessel Vt by using each 
center position C1_0 and C2_0 obtained in step S323 (step S324). That is, this 
"vector of the actual extending direction" is a vector that starts from the start point SP 
of the target vessel to the actual position that is apart by a distance of t/2 (t is the 
15 width of the parallel cross sectional regions PR1_0 and PR2J3) from the start point 
SP. Here, the control unit 310 can obtain the vector of the extending direction of the 
target vessel Vt that starts from the orthogonal cross sectional region SR_0 by, for 
example, calculating numerical formulae shown in FIG. 13. 

[00208] That is, 
20 [00209] InthecaseV2-nl>V3-nl, 

[00210] The vector parallel to the actual extending direction = 
v2 , »nl*nl+v2'"n3*n3+v3"n2*n2 

[00211] where, v2'=v3 ■ nl/v2 ■ nl*v2 

[00212] In the case V2 ■ nl ^ V3 ■ nl, 
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[00213] The vector parallel to the actual extending direction = v2 ■ 
nl*nl+v2"n3*n3+v3'"n2*n2 

[00214] where, v3'=v2 ■ nl/v3 ■ nl*v3 

[00215] In the above Formulae, ■ represents inner products of vectors, and * 
5 represents outer products of vectors. 

[00216] By this vector calculation, a direction DirB_0 shown in FIG. 14A, 
which is the actual extending direction, can be obtained. That is, the temporary 
marching (advancing, progressing) direction DirA_0 is corrected to the marching 
(advancing, progressing) direction DirB_0. Hereinafter, a direction obtained in this 

10 manner will be represented as "settled marching (advancing, progressing) direction 
DirB". The settled marching (advancing, progressing) direction DirB is obtained for 
each of the orthogonal cross sectional regions SR_0 to SR_n in the following process. 
Therefore, the settled marching (advancing, progressing) directions DirB 
corresponding to the respective orthogonal cross sectional regions will be represented 

15 as "settled marching (advancing, progressing) directions DirB_0 to DirB_n". 

[00217] The control unit 310 regards the thusly obtained settled marching 
(advancing, progressing) direction DirB_0 as a marching (advancing, progressing) 
direction for determining the position of a cross sectional region to be specified next 
to the orthogonal cross sectional region SR_0 (i.e. the orthogonal cross sectional 

20 region SR_1). Further, the control unit 310 stores the settled marching (advancing, 
progressing) direction DirB_0 in the work area or the like as a temporary marching 
(advancing, progressing) direction to be used for determining the next marching 
(advancing, progressing) direction (the extending direction from the orthogonal cross 
sectional region SR_1 to the next orthogonal cross sectional region SR_2) (step 

25 S325), and completes the "marching (advancing, progressing) direction settling 
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process" for the orthogonal cross sectional region SR_0. 

[00218] Returning to the flow of the "vessel image extracting process" 
shown in FIG. 8, the control unit 310 specifies the next orthogonal cross sectional 
region SR (in this case, the orthogonal cross sectional region SR_1) that is orthogonal 
5 to the settled marching (advancing, progressing) direction DirB_0 obtained in step 
S325, by the same procedure as step S303 (step S305). That is, such an orthogonal 
cross sectional region SR_1 as shown in FIG. 14B is specified. The distance between 
the formerly specified cross sectional region to the next specified cross sectional 
region is arbitrarily set in accordance with the process capacity of the image 

10 processing apparatus 300, a desired precision, etc. 

[00219] The orthogonal cross sectional region SR_1 specified in step S305 is 
oriented in a direction orthogonal to the settled marching (advancing, progressing) 
direction DirB_0 originating from the start point SP which is the center of the 
orthogonal cross sectional region SR_0 immediately before the region SR_1. 

15 Therefore, the newly specified orthogonal cross sectional region SR_1 is also a region 
which is in a cross sectional direction of the target vessel Vt and in whose center the 
center of the cross section is positioned, likewise the orthogonal cross sectional region 
SR_0. 

[00220] In such a case as shown in FIG. 9C where the cross section of the 
20 vessel only exists in the concerned orthogonal cross sectional region SR, the 
extraction of the cross section of the vessel and the center of the vessel is easy. 
However, as shown in FIG. 15 A, in many cases, the target vessel Vt in the specified 
orthogonal cross sectional region SR is close to a heart HT or another vessel Vx than 
the target vessel Vt. For example, an orthogonal cross sectional region SR 
25 ("orthogonal cross sectional region SR_exl" in FIG. 15 A) obtained at a place where 
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the target vessel Vt is close to the heart HT, includes portions of the heart HT in 
addition to the cross section of the target vessel Vt, as shown in FIG. 15B. Further, an 
orthogonal cross sectional region SR ("orthogonal cross sectional region SR_ex2" in 
FIG. 15 A) obtained at a place where the target vessel Vt is close to another vessel Vx 
5 includes the cross section of the vessel Vx in addition to the cross section of the target 
vessel Vt, as shown in FIG. 15C. 

[00221] In these cases, in order to determine the cross section and center of 
the target vessel Vt, the orthogonal cross sectional region may be imaged. That is, the 
orthogonal cross sectional region may be imaged based on the CT values indicating 

10 this orthogonal cross sectional region, and the cross section of the target vessel Vt 
may be extracted as an image. The CT values are X-ray absorption factors acquired 
by the modality 100 (CT scanner), and materials have their own fixed CT values, such 
as, for example, "water : 0", "air : -1000", etc. Accordingly, in a case where the cross 
section of the target vessel Vt is imaged, only the target vessel Vt can be imaged and 

15 extracted by data-converting the picture elements corresponding to the CT values 
corresponding to the materials (blood, vessel wall, contrast medium, etc.) constituting 
the vessel. However, in a case where a heart or other vessels are close to the target 
vessel, the materials constituting those are almost equal to the materials of the target 
vessel Vt. Therefore, differences in the CT values are small. Thus, the image 

20 obtained by data-converting such an orthogonal cross sectional region results in that 
the cross section of the target vessel Vt and the cross sections of the close heart HT 
and vessel Vx are combined, as shown in FIGS. 16A and 16B. That is, the cross 
section and center of the target vessel Vt can not be recognized. 

[00222] Thus, the control unit 310 performs a "vessel center detecting 

25 process" (step S340) for recognizing such slight differences in the CT values to 
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clarify the cross section of the target vessel so as to be identifiable and detect the 
center of the cross section. This vessel center detecting process will be explained 
with reference to a flowchart shown in FIG. 17. In this process, the center of the cross 
section will be detected by changing the range of CT values (hereinafter referred to 
5 as "target CT value range") used for data-converting the target area and clarifying the 
image representing the cross section of the target vessel Vt. 

[00223] First, the control unit 310 sets the range of "threshold" (hereinafter 
referred to as "threshold range") used for changing the target CT value range (step 
S341). In the present embodiment, the target CT value range is changed by changing 

10 a threshold indicating the lower limit of the "target CT value range" in the following 
process. Therefore, the control unit 310 firstly defines a change range of the threshold 
(minimum threshold th_min to maximum threshold th_max). 

[00224] The "target CT value range" is a range of CT values which are the 
target when data-converting the target portion inside a biological body (human body). 

15 As described above, materials have their own fixed CT values. In a case where an 
internal portion of a human body is the target of data-conversion, the target of is an 
organ, blood (contract medium), a bone, or the like. Accordingly, a range of CT 
values corresponding to such an organ, etc. is predefined as the target CT value range. 
Then, since the threshold is changed in the thusly predefined target CT value range, 

20 the threshold range shares the same range as the target CT value range. 

[00225] As described above, the "threshold" according to the present 
embodiment indicates the lower limit value of the CT value range that is displayed as 
an image (the target CT value range). That is, in a case where a certain threshold is 
designated, all the CT values that are equal to or larger than the CT value 

25 corresponding to this threshold are the target of displaying as an image. On the other 
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hand, the CT values that are smaller than the CT value corresponding to this threshold 
are ignored for the target of the displaying (treated as a transparent color). 
Accordingly, coordinates having characteristic information representing the CT 
values included in the "target CT value range" in the three-dimensional volume data 
5 constituting the concerned region are the target of imaging. For example, in a case 
where the threshold range (target CT value range) is "0 to 1000" and the threshold is 
set to "100", coordinates whose characteristic information represents a CT value 
included in the range of "100 to 1000" are imaged. 

[00226] Further, in a case where the CT values, which are the X-ray 

10 absorption factors, are used for imaging, the differences in the CT values are 
expressed as differences in brightness. In this case, imaging is carried out by using 
binary value data where picture elements whose characteristic information represents 
CT values that are the target of imaging are assigned "1", and picture elements whose 
characteristic information represents the other CT values are assigned "0". In the 

15 present embodiment, it is assumed that CT values representing blood are raised by 
using a contrast medium at the time of image acquiring. Further, it is assumed that 
"imaging" means data-conversion with the use of such binary value data. The 
following explanation will be made by employing as an example, a process performed 
for the orthogonal cross sectional region SR_ex2 (FIGS. 15 A) where another vessel 

20 Vx exists closely to the target vessel Vt. 

[00227] First, the control unit 310 sets the minimum threshold th_min set in 
step S341 as the threshold th (step S342), and images picture elements fit inside the 
orthogonal cross sectional region SR_ex2 that have, as characteristic information, CT 
values equal to or larger than the set threshold th (step S343). In a case where the 

25 threshold th is the minimum threshold th_min, all the CT values that are within the 
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threshold range (minimum threshold th__min to maximum threshold_max) are the 
target of data-conversion. Here, a range of CT values at which an internal portion of a 
biological body can be imaged is set as a threshold range. Therefore, in a case where 
the threshold value th is the minimum threshold th_min, by imaging picture elements 
5 in the orthogonal cross sectional region SR_ex2 shown in FIG. 15 A, not only the cross 
section of the target vessel Vt and the cross section of the close vessel Vx, but also 
portions including other tissues around the target vessel Vt and close vessel Vx are 
imaged, as shown in FIG. 18 A. 

[00228] In a one-dimensional range in an X direction that passes through the 

10 center of the region (i.e. a region "X0 to XI" on a line "X to X' " in FIG. 18 A), the 
distribution of picture elements having CT values corresponding to the set threshold 
can be represented as a graph Gl shown in FIG. 18B. In FIG. 18B, the horizontal 
axis represents the coordinates (X0 to XI) of the one-dimensional range (x-x') in the 
orthogonal cross sectional region SR_ex2, and the vertical axis represents CT values. 

15 Due to the use of a contrast medium, the CT values corresponding to the target vessel 
Vt and close vessel Vx are relatively high. Accordingly, two peaks appear in the 
curved graph in the graph Gl. That is, these peaks respectively show the positions of 
the target vessel Vt and close vessel Vx. The area covered with slanted lines in the 
curved graph shows the distribution of picture elements having CT values equal to or 

20 larger than the threshold th (in this case, the minimum threshold th_min). Hereinafter, 
the graph Gl will be timely referred to, for explaining the relationship between the 
threshold to be changed in the following process and picture elements which becomes 
the target at that time. 

[00229] Next, the control unit 310 specifies a range of the image that appears 

25 in the center position of the orthogonal cross sectional region SR_ex2 in the image 
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obtained in step S343 (step S344). In the present embodiment, data-conversion is 
done based on binary value data, as described above. Due to this, the area of picture 
elements having CT values corresponding to the set threshold appears clearly as 
shown in FIG. 18A (the slanted line portion in FIG. 18 A). 
5 [00230] In this case, some orthogonal cross sectional regions may have a 

plurality of areas containing the picture elements that have CT values equal to or 
larger than the set threshold, as shown in FIG. 19A. In the present embodiment, an 
area including picture elements enclosed by the same outline is recognized 
(determined) by such a method as "Flood Fill" or the like, and treated as one unit 

10 (hereinafter referred to as "unit image"). In the example shown in FIG. 19A, two unit 
images, namely "unit image 1" and "unit image 2" appear. 

[00231] Accordingly, the control unit 310 specifies the range of the unit 
image that appears in the center position of the orthogonal cross sectional region 
SR_ex2 in step S344. Here, the "range" corresponds to the outline of the unit image. 

15 That is, as shown in FIG. 19B, the control unit 310 specifies the outline of the unit 
image that includes the center of the orthogonal cross sectional region SR_ex2 (the 
center is indicated by "+" in FIG. 19B) (a unit image including the center will 
hereinafter be referred to as "center unit image"). In FIG. 19B, a line segment that is 
indicated by a bold line is specified as the range (outline) of the center unit image. 

20 [00232] The control unit 310 determines whether the range of the center unit 

image specified in step S344 is fit inside the orthogonal cross sectional region SR_ex2 
or not (step S345). In other words, the control unit 310 determines whether or not the 
range of the center unit image extends beyond the orthogonal cross sectional region 
SR_ex2. The control unit 310 determines whether the outline specified in step S344 

25 contacts any side of the orthogonal cross sectional region SR_ex2. When it contacts, 



44 



Atty. Docket No. 60,233-005 

the control unit 310 determines that the center unit image extends beyond the 
orthogonal cross sectional region SR_ex2. In case of FIG. 19B, some parts of the 
outline of the center unit image contact the upper side and right side of the orthogonal 
cross sectional region SR_ex2. Accordingly, it is determined that the center unit 
5 image is not fit inside the orthogonal cross sectional region SR_ex2. 

[00233] The control unit 310 associates the determination result with the 
threshold at this time, and records them as "threshold attribute information" in a 
predetermined storage unit (for example, the work area, the image storage unit 360, or 
the like) (step S345). 

10 [00234] Next, the control unit 310 obtains the area of the center unit imaged 

specified in step S344. The control unit 310 associates the area value with the 
threshold at this time, and records them as "threshold attribute information" in a 
predetermined storage unit (step S346). 

[00235] Afterwards, the control unit 310 sequentially changes the threshold 

15 th until it becomes the maximum threshold th_max, and performs the procedures of 
steps S343 to S346 at each threshold (step S346: No, S348). That is, the control unit 
310 increments the threshold th from the minimum threshold th_min to the maximum 
threshold th__max, and performs (1) data-conversion, (2) specifying of the center unit 
image, (3) determining of the range of the center unit image and recording of the 

20 determination result, and (4) calculating and recording of the area of the center unit 
image at each threshold. Due to this, the threshold attribute information recorded in 
steps S345 and 346 are stored in the predetermined storage unit as a "threshold 
attribute table" shown in FIG. 20. The incrementing rate for the threshold th (i.e. the 
lower limit value of the CT value range that is the target of imaging) is arbitrary, and 

25 is therefore arbitrarily set in accordance with process capacity of the image processing 
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apparatus 300 and a desired accuracy. In the present embodiment, the threshold th is 
incremented by for easier understanding. 

[00236] The control unit 310 detects the center of the target vessel Vt in the 
orthogonal cross sectional region SR_ex2 by using the "threshold attribute 
5 information". For this detection, the control unit 310 performs a "cross section 
clarifying process" (step S360) for clarifying the cross section of the target vessel Vt 
in the image based on the changes of the areas (image attribute). This "cross section 
clarifying process" will be explained with reference to a flowchart shown in FIG. 21. 

[00237] First, the control unit 310 acquires "area values" from the threshold 

10 attribute table shown in FIG. 20, and obtains a distribution of areas of the center unit 
image in the set threshold range (step S361). In this example, the control unit 310 can 
obtain a graph G2 representing an area distribution shown in FIG. 22, by plotting each 
area value. In the graph G2, the horizontal axis represents the threshold th (minimum 
threshold th_min to maximum threshold th_max), and the vertical axis represents the 

15 area of the center unit image. As shown in FIG. 22, as the threshold th changes from 
the minimum threshold th_min to the maximum threshold_max, the area value of the 
center unit image decreases. This is because the imaging target CT value range is 
narrowed in accordance with the change of the threshold th, and thereby the area of 
the region to be imaged is reduced. 

20 [00238] The control unit 310 obtains area change rates of the center unit 

image (step S362). In this step, the control unit 310 can obtain the area change rates 
by defining the area distribution obtained in step S361 as a piecewise function, and 
differentiating this piecewise function. 

[00239] Next, the control unit 310 refers to the threshold attribute table, and 

25 excludes the thresholds at which the center unit image is not fit inside the orthogonal 
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cross sectional region SR_ex2 (step S363). This exclusion is done because in a case 
where the cross section of the target vessel has a generally circular shape and is 
positioned in the center of the orthogonal cross sectional region SR, the image of the 
cross section whose outline is clarified (or clarified image) can not extend beyond the 
5 orthogonal cross sectional region. 

[00240] During the process of incrementing the threshold th (that is, the 
process of narrowing the target CT value range), there are some cases where the area 
of the center unit image sharply decreases, as shown by the graph G2 in FIG. 22. In 
the example of the graph G2, the area sharply decreases when the threshold changes 

10 from th_a to th_a+l, and from th_b to th_b+l. The change of the threshold th "from 
th_a to th_a+l" is when the center unit image that has been extending beyond the 
region so far comes fit inside the region along with the decrease of the area. The 
change of the threshold th "from th_b to th_b+l" is when the center unit image is 
clarified such that it represents the cross section of the target vessel Vt. The former, 

15 that is, an example of the case the center unit image is fit inside the region along with 
the decrease of the area will be explained by employing FIGS. 23 and FIGS. 24, and 
the latter, that is, an example of the case the center unit image is clarified will be 
explained by employing FIGS. 25 and FIGS. 26. 

[00241] FIG. 23A shows an example of an image obtained when the 

20 threshold th is th_a. FIG. 23B shows a graph Gl representing picture element 
distribution in a range (X0 to XI) of a one-dimensional region (x-x') shown in 
FIG.23A in case of threshold th_a. FIG. 24A shows an image obtained when the 
threshold th is th_a+l. FIG. 24B shows a graph Gl representing picture element 
distribution in a range (X0 to XI) of a one-dimensional region (x-x') shown in 

25 FIG.24A in case of threshold th_a+l. 
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[00242] As shown in FIG. 23A, the outline of the center unit image contacts 
the sides of the orthogonal cross sectional region at the time of threshold th_a. 
Further, as shown in FIG. 23B, the picture elements whose CT value range is equal to 
or larger than the threshold (slanted line area) at the time of threshold th_a reach the 
5 position XI which is at the end of the one-dimensional range (x-x'). Then, as shown 
in FIG. 24 B, when the threshold th is changed from th_a to th_a+l, the picture 
elements whose CT value range is equal to or larger than the threshold becomes off 
from the position XI at the end of the one-dimensional range (x-x'). That is, as 
shown in FIG. 24A, the center unit image that has been contacting the right side and 

10 upper side of the orthogonal cross sectional region becomes fit inside the region. At 
this time, a clearance is produced between the outline of the center unit image and the 
sides of the orthogonal cross sectional region. Due to this, the area of the center unit 
image sharply decreases, showing such a change as shown by the graph G2 (FIG. 22). 
[00243] On the other hand, FIG. 25A shows an image obtained in case of 

15 threshold th being th_b. FIG. 25B shows a graph Gl representing the picture 
elements which are in a range of CT values is equal to or larger than the threshold in a 
range (X0 to XI) of a one-dimensional region (x-x') in case of threshold th_b. FIG. 
26A shows an image obtained in case of threshold th being th_b+l. FIG. 26B shows 
a graph Gl representing picture element distribution in a range (X0 to XI) of a one- 

20 dimensional region (x-x') in case of threshold th being th_b+L 

[00244] As shown in FIG. 25A, at the time of threshold th is th_b, the center 
unit image is a combined image of both the cross sections of the target vessel Vt and 
close vessel Vx. Further, as shown in FIG. 25B, the threshold th_b corresponds to the 
height of the valley between two peaks appearing in the curved graph. That is, the 

25 graph Gl shows a picture element distribution including both of the two peaks. Then, 
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as shown in FIG. 26B, when the threshold th is changed from th_b to th_b+l, the 
picture element distribution is divided into two areas which contain the respective 
peaks. That is, as shown in FIG. 26A, the center unit image that has been showing 
both the cross sections of the target vessel Vt and close vessel Vx integrally is divided 
5 into two parts. One part is the center unit image showing the cross section of the 
target vessel Vt, and the other is a unit image showing the cross section of the close 
vessel Vx. That is, the cross section of the target vessel Vt is clarified. Since the 
control unit 310 detects the area change of the center unit image, the area of the unit 
image representing the vessel Vx is subtracted from the area of the center unit image. 

10 Thus, a large area decrease appears in the graph G2 (FIG. 22). 

[00245] As described above, it is possible to determine whether the image of 
the vessel Vt is clarified or not, by detecting such a sharp decrease in the area of the 
center unit image. However, in some case, an area change when the center unit image 
becomes fit inside the region might be larger than an area change when the cross 

15 section of the target vessel is clarified, depending on variation of conditions such as 
the location of the orthogonal cross sectional region and the shape of the center unit 
image. Therefore, a threshold at which the area change is the largest in the threshold 
range cannot necessarily be the threshold that clarifies the image of the cross section 
of the vessel. The control unit 310 therefore excludes thresholds at which the outline 

20 of the center unit image extends beyond the orthogonal cross sectional region by 
referring to the "threshold attribute table" in step S363. Then, the control unit 310 
specifies a threshold at which the area change is the largest among thresholds 
remaining after the exclusion (step S364). 

[00246] In the example of the graph G2 in FIG. 22, the range of thresholds 

25 that are excluded is represented as a non-target area (NG area). A large area change 
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occurs when the threshold th changes from th_a to th_a+l. However, since the 
threshold th_a is a threshold in the NG area (since the center unit area that is 
contacting the right side and upper side of the region as shown in FIG.23A), the 
threshold th_a is excluded from the detection target. Accordingly, a threshold at 
5 which the area change is the largest in the thresholds th_a+l to th_max, i.e. the 
threshold th_b+l is detected. In a case where the area change rates are obtained by 
the above-described "differentiation of a piecewise function", a threshold at which a 
minimum differentiation value is obtained can be regarded as a "threshold at which 
the area change is the largest". 

10 [00247] The control unit 310 images picture elements whose CT value is 

inside a CT value range whose lower limit value is the threshold specified in step 
S364 and whose upper limit value is the threshold th_max. As a result, the control 
unit 310 acquires a clear image of the target vessel Vt as shown in FIG. 26A (step 
S365), and returns to the flow of the "vessel center detecting process" shown in FIG. 

15 17. 

[00248] When obtaining a center unit image representing the cross section of 
the target vessel Vt clarified in step S365, the control unit 310 recognizes the shape, 
size, etc. of the center unit image by a Flood Fill method or the like, and determines 
the accurate center position of the center unit image (step S349). In step S305, the 

20 control unit 310 specifies each orthogonal cross sectional region SR in whose center 
the cross section of the target vessel Vt is positioned. Therefore, the control unit 310 
can accurately obtain the center of the target vessel Vt by obtaining the center of the 
imaged cross section of the vessel Vt. The orthogonal cross sectional region SR is a 
region in the three-dimensional volume data. Accordingly, if a specific position in the 

25 orthogonal cross sectional region SR is determined, the position can be specified as 
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coordinate of the three-dimensional volume data. That is, the control unit 310 
acquires the center position of the cross section of the vessel Vt as coordinate 
information (x, y, z). When determining the center of the cross section of the target 
vessel in the orthogonal cross sectional region, the control unit 310 returns to the flow 
5 of the "vessel image extracting process" shown in FIG. 8. 

[00249] The control unit 310 performs the above processes for each of the 
orthogonal cross sectional regions SR_0 to SR_n (step S306: No). That is, the control 
unit 310 acquires coordinate information representing the center position of the target 
vessel in each orthogonal cross sectional region SR which is sequentially specified 

10 based on the marching (advancing, progressing) direction settled in the marching 
(advancing, progressing) direction settling process. In the above explanation for the 
marching (advancing, progressing) direction settling process, the marching 
(advancing, progressing) direction is corrected and settled based on the center of the 
orthogonal cross sectional region SR_0, because the explanation is for the process to 

15 be performed for the first round. However, in a case where the center position of the 
target vessel is determined in the vessel image extracting process, the marching 
(advancing, progressing) direction should be settled based on the determined center 
position of the target vessel. 

[00250] As a result of sequentially performing the above processes, the 

20 center of the target vessel in the orthogonal cross sectional region SR_n at the end 
point EP which is designated in step S302 is determined (step S306: Yes). Due to 
this, the control unit 310 obtains a three-dimensional path representing the center line 
of the target vessel Vt in its longitudinal direction, based on the coordinate 
information representing the center of the target vessel obtained in each orthogonal 

25 cross sectional region (step S307). That is, since the center position of the cross 
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section in each orthogonal cross sectional region SR has been obtained as coordinate 
information, the center line of the target vessel Vt can be specified as a path 
connecting each obtained center. Accordingly, a path (hereinafter referred to as "path 
P_Vt") of the center line from the start point SP to the end point EP shown in FIG. 27 
5 can be obtained. The control unit 310 of the image processing apparatus 300 
performs generation and display of various medical images, using the obtained path 
P_Vt (step S500: FIG. 6). 

[00251] In the above-described "vessel image extracting process", the path 
P_Vt, which is vector information representing the center line of the target vessel Vt 

10 is obtained. The control unit 310 of the image processing apparatus 300 can generate 
a three-dimensional image shown in FIG. 28 representing a coronary vessel, by 
performing an arbitrary three-dimensional image processing (for example, volume 
rendering, etc.) along the path P_Vt. That is, since the path data representing the 
center line has been obtained in the above-described "vessel image extracting 

15 process", even a portion at which the vessel diameter is narrowed can be three- 
dimensionally imaged without the vessel being discontinuous. Further, as described 
above, according to the "vessel image extracting process", even if a heart or another 
vessel closely exists, the center line of the target vessel can be accurately detected. 
Therefore, even with a coronary vessel, which has been difficult to three - 

20 dimensionally image accurately, such an accurate three-dimensional image as shown 
in FIG. 28 can be generated. 

[00252] Further, since the path P_Vt obtained in the above-described "vessel 
image extracting process" is vector data, various conversion or processing can be 
applied thereto. That is, the path P_Vt is "three-dimensional path data" derived from 

25 three-dimensional coordinate data. However, the control unit 310 of the image 
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processing apparatus 300 can convert it into "two-dimensional path data" by 
performing predetermined calculations, etc., and can display the vessel as a linear 
two-dimensional image (tree view). Further, the control unit 310 can associate the 
path data with a medical image in another format which is generated with the use of 
5 the three-dimensional volume data acquired by the modality 100. That is, the control 
unit 310 can display at the same time a plurality of medical images in different 
display formats (coordinate systems) concerning the same target, and can mutually 
associate the positions of the target in the respective images. 

[00253] FIG. 29 shows an example of such image display. The display 

10 screen of this example has a plurality of display areas (left, center, right) as shown in 
FIG. 29. Due to this, medical images in different display formats (coordinate 
systems) are displayed on the output device 34 (in this case, a display device), under 
the control of the control unit 310 and output control unit 340. For example, in the 
left area, a "three-dimensional image" of a heart and a coronary vessel is displayed in 

15 the upper section, and "two-dimensional path data" converted from three-dimensional 
path data is displayed in the lower section. Here, it is assumed that an image 
representing a three-dimensional path can be displayed while being overlaid on a 
three-dimensional image. That is, when a vessel displayed as a three-dimensional 
image is designated by a pointer such as a cursor, the three-dimensional path of this 

20 vessel is displayed over the three-dimensional image of the designated vessel. 

[00254] The conversion of the three-dimensional path data into the two- 
dimensional path data is for making a tree view by converting the three-dimensional 
path data into the two-dimensional path data while maintaining the topology 
(connection/branch relation). In this conversion, for example, a coronary vessel can 

25 be represented as a so-called non-cyclic graph having branch points. Accordingly, in 
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a case where a coronary vessel is represented as a two-dimensional path, the coronary 
vessel can be expressed without the branches intersecting with each other. Further, 
the three-dimensional path and the two-dimensional path can be easily associated with 
each other positionally, by calculating the vessel length based on the three- 
5 dimensional path data. 

[00255] Accordingly, if an arbitrary vessel is designated on the three- 
dimensional image displayed in the upper section of the screen, the three-dimensional 
path of this vessel is displayed on the three-dimensional image. Meanwhile, in the 
lower section of the screen, the two-dimensional path representing this vessel is 

10 emphatically displayed. That is, by the calculations of the control unit 310, positional 
information (nodes) in both the images are associated with each other relatively. Due 
to this, a pointer displayed on the three-dimensional image and a pointer displayed on 
the two-dimensional path image are linked with each other, making possible such a 
display that one pointer moves in accordance with the move of the other pointer. 

15 [00256] The three-dimensional volume data acquired by the modality 100 

may be able to include, for example, various measurement data, other than coordinate 
information and CT values. Using such measurement data, numerical value data such 
as bloodstream amount and vessel diameter, etc. can be obtained. These data can not 
only be associated with the three-dimensional path data, but also associated with two- 

20 dimensional path data that is obtained by converting the three-dimensional path data. 
Accordingly, by the control unit 310 obtaining these measurement data as parameters, 
the vessel diameter and differences in the bloodstream amounts can be visibly 
displayed. For example, a portion where the vessel diameter is equal to or less than a 
predetermined threshold in the two-dimensional path image can be displayed in a 

25 color different from the color of other portions. 
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[00257] It is generally said that the probability that an abnormality occurs at 
a portion where the vessel diameter is narrowed is high. A three-dimensional image 
has a defect that an abnormality that occurs in a vessel or a portion where the diameter 
is narrowed is difficult to spot, although it is suitable for grasping the spatial 
5 positional relation of a vessel. Thus, the two-dimensional path data in the above- 
described display format is displayed together with the three-dimensional image. This 
makes it possible to confirm the abnormality or the portion where the diameter is 
narrowed on the two-dimensional path image as to in which part of which vessel such 
abnormality, etc. is located, and to confirm the location in the three-dimensional 

10 image, as the actual location. 

[00258] Further, as shown in FIG. 29, a CPR (Curved-Planer 
Reconstruction) image or the like representing the target vessel is displayed in the 
lower and middle sections of the center display area. CPR is for designating an 
arbitrary curved region in three-dimensional volume data. For example, by 

15 designating a curved region along a vessel, a cross section of the vessel in the 
longitudinal direction can be displayed in one screen. In the example of FIG. 29, an 
image in a "CPR non-linear mode" is displayed in the upper section, and an image in 
a "CPR linear mode" is displayed in the lower section. The "non-linear mode" is for 
data-converting the designated curved region without any special processing. The 

20 "linear mode" is for simulatively expanding the designated curved region and 
displaying the target vessel as a linear image. 

[00259] The coordinate information of the displayed CPR image can also be 
associated with three-dimensional path data and two-dimensional path data by 
calculations of the control unit 310. Accordingly, if a desired vessel is designated 

25 from either of the three-dimensional image or the two-dimensional path, a CPR image 
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of the designated vessel is displayed in the center area. If the pointer is moved on the 
three-dimensional image, the pointer on the CPR image is also moved in response to 
this. Since various information can be included in the volume data as described 
above, the control unit 310 generates a graph based on these information and displays 
5 the graph in the lower section. Various information regarding a position designated 
from the above-described three-dimensional image or the like can be shown by this 
graph. For example, if a plurality of points on a vessel are designated from a CPR 
image, information such as vessel diameter, constriction degree, etc. regarding the 
respective designated point is graphed and displayed so that the generated graphs can 
10 be compared. 

[00260] In the right area, an MPR image representing a cross section of a 
vessel is displayed. The coordinate information of this MPR image is also associated 
with coordinate information of other types of images by calculations of the control 
unit 310. Accordingly, if a plurality of points on a vessel are designated from the 

15 MPR image, the cross sections of the vessel at the designated points are displayed. 

[00261] Since positional information of these kinds of displayed images is 
mutually linked, if any point is designated from any image, a corresponding position 
is visibly displayed on the other kinds of images. Due to this, a plurality of images in 
different display formats (coordinate systems) can be displayed in one screen, and can 

20 be seen parallely, making it possible to grasp the positional relationship between the 
images correspondingly. Accordingly, spotting of an abnormal portion can be carried 
out by using two-dimensional path data or an MPR image, while the operation of the 
abnormal portion can be carried out by seeing a three-dimensional image to confirm 
the actual location of the abnormal portion. This contributes to improvement of 

25 accuracy of diagnosis and medical treatment. 
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[00262] As explained above, according to the image diagnosis system 1, in 
generating an image of a tubular tissue such as a vessel, the cross section of the vessel 
is clarified by changing a threshold in each orthogonal cross sectional region. 
Therefore, even in a case where, for example, CT values suddenly fluctuate in the 
5 middle of a vessel because of a change in the vessel diameter or an abnormal portion, 
the center line of the vessel can be accurately extracted. Accordingly, a good image 
with no discontinuation, etc. can be obtained. Further, the center of a cross section is 
detected by clarifying a cross section of a vessel in each orthogonal cross sectional 
region. Therefore, even in a case where other organs, etc. having similar CT values 

10 closely exist, the center line of the target vessel can be accurately extracted. 
Furthermore, the center line of the target vessel can be obtained as path data. The 
obtained path data can be mutually linked with a plurality of medical images in 
different display formats, and these medical images can be displayed at the same time. 
Consequently, medical image display that is quite helpful for diagnosis and treatment 

15 for a coronary vessel around a heart can be realized. 

[00263] In the above described explanation, the orthogonal cross sectional 
region SR_exl, the orthogonal cross sectional region SR_ex2 and their median points 
are obtained to obtain the median point of the tubular tissue in each micro-area. 
However, the method of obtaining the median point is not limited to this. For 

20 example, it can be directly obtained by obtaining directly the coordinates of the 
median point from voxel data. 

[00264] (Second Process Method) 

[00265] Next, the vessel image extracting process employing the continuous 
region specifying method will be explained with reference to a flowchart shown in 
25 FIG. 30. In the present process, the image processing apparatus 300 extracts a three- 
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dimensional image of a desired vessel by using acquired image data obtained in the 
"image acquiring process". In the present embodiment, explanation will be made by 
employing as an example, a case where the target of extraction is a coronary vessel 
around a heart. 

5 [00266] First, the image processing apparatus 300 obtains process target 

three-dimensional volume data (acquired image data) from the control terminal 200 
via the communication network 10 (step S401). 

[00267] Next, the control unit 310 displays a two-dimensional image based 
on the acquired image (three-dimensional volume data) obtained in step S401 on the 

10 output device 34 (display device). Then, the control unit 310 receives designation of 
an extraction start point and extraction end point of a vessel regarded as a target of 
extraction (hereinafter referred to as "target vessel Vt") (step S402). In this step, an 
operator such as a doctor, etc. operates the input device 33 and designates the 
extraction start point and extraction end point on the displayed two-dimensional 

15 image. 

[00268] FIG. 31A shows an example of the two-dimensional image 
displayed herein. An image representing a cross section of the target vessel Vt, which 
is acquired by the above-described MPR, etc. is displayed on the output device 34. 
That is, an image of a cross section of the target vessel Vt is displayed by data- 

20 conversion darkness and brightness based on differences in the CT values included in 
three-dimensional volume data. The image processing apparatus 300 arbitrarily 
changes the display such that the position or angle of display is changed, by data- 
converting the three-dimensional volume data corresponding to a position or direction 
designated by the operator by operating the input device 33. In a case where the 

25 target of image acquiring is a vessel, a contrast medium is usually used to raise the CT 
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values of blood. Due to this, as shown in FIG. 31 A, the vessel portion is displayed 
relatively brightly. The operator operates the input device 33, and changes the display 
screen so that a cross section of the target vessel Vt at the extraction start point will be 
displayed. The operator designates the center of the displayed cross section 
5 (hereinafter the center will be referred to as "start point SP"), by using the input 
device 33. Likewise, the operator designates the center of a cross section at the 
extraction end point (the center will hereinafter be referred to as "end point EP"). 

[00269] When the start point SP is designated in step S402, the control unit 
310 of the image processing apparatus 300 specifies the three-dimensional 

10 coordinates (x,y,z) of the start point SP. When the three-dimensional coordinate of 
the start point SP are specified, the control unit 310 specifies a three-dimensional 
region having a cubic shape whose center (median point) is the start point SP 
(hereinafter the region will be referred to as "three-dimensional region TDR" and the 
center of the three-dimensional region TDR will be referred to as "center CP") (step 

15 S403). In this step, the control unit 310 specifies a three-dimensional region by, for 
example, combining planer regions designated by the above-described MPR. 

[00270] When the three-dimensional region TDR is specified, the control 
unit 310 obtains three-dimensional data for the specified three-dimensional region 
TDR (step S404). That is, the control unit 310 extracts data corresponding to the 

20 three-dimensional region TDR in the three-dimensional volume data obtained in step 
S401. 

[00271] Next, the control unit 310 generates a three-dimensional image by 
using the obtained three-dimensional volume data for the three-dimensional region 
TDR (step S405). In this step, the control unit 310 generates a three-dimensional 
25 image by using the three-dimensional volume data in accordance with Flood Fill 
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method, Region Growing method, etc. 

[00272] According to the present embodiment, such three-dimensional 
regions TDR as described above will be sequentially specified along the target vessel 
Vt (from the start point SP to the end point EP). Then, a three-dimensional vessel 
5 image covering a range from the start point SP to the end point EP will be generated 
by connecting three-dimensional vessel images (hereinafter referred to as "unit vessel 
image") in the respective three-dimensional regions TDR. Therefore, the control unit 
310 performs a "unit vessel image generating process" (step S420) for generating 
such a "unit vessel image". The "unit vessel image generating process" will be 

10 explained with reference to a flowchart shown in FIG. 33. 

[00273] First, the control unit 310 specifies a continuous region including 
the start point SP (center CP) from the three-dimensional image generated in step 
S405 (step S421). A "continuous region" is a closed image having the same outline 
(limited closed image) which is obtained by, for example, Flood Fill method, or the 

15 like. In step S421, the control unit 310 specifies a range of a continuous region within 
the generated three-dimensional image and including the coordinates of the center CP 
of the three-dimensional region TDR (hereinafter this continuous region will be 
referred to as "continuous region CIM"). 

[00274] Next, the control unit 310 specifies positions at which the specified 

20 continuous region CIM and a surface of the three-dimensional region TDR (one 
surface of the cube) contact with each other (step S422). Then, the control unit 310 
determines whether the number of such positions is equal to or greater than 3 (step 
S423). In this step, it is determined whether or not the continuous region CIM is a 
three-dimensional image representing only the target vessel Vt (such a continuous 

25 region CIM will hereinafter be referred to as "unit vessel image IMv"). 



60 



Atty. Docket No. 60,233-005 

[00275] That is, in a case where only the target vessel Vt exists in the 
specified three-dimensional region TDR as shown in FIG. 32A, the continuous region 
CIM obtained by data-converting the three-dimensional region TDR in step 405 
should be such a vessel image IMv as shown in FIG. 32B. 
5 [00276] However, in a case where a coronary vessel around a heart is the 

target, a heart HT or another vessel Vx are close to the target vessel Vt as shown in 
FIG. 34. If the start point SP on the target vessel Vt is designated in a case where the 
heart HT is close to the target vessel Vt, a part of the heart HT is included in the three- 
dimensional region TDR as shown in FIG. 35A. 

10 [00277] If such a three-dimensional region TDR is imaged, the generated 

image will be as shown in FIG. 35B. As described above, according to the present 
embodiment, data-conversion is carried out by using CT values included in the three- 
dimensional volume data. CT values represent X-ray absorption factors acquired by 
the modality 100 (CT scanner), and any materials have their own fixed CT values 

15 such as, for example, "water : 0", "air : -1000", etc. Accordingly, in a case where the 
target vessel Vt is to be imaged, only the target vessel Vt can be imaged by displaying 
only the picture elements (pixels, voxels) having CT values corresponding to the 
substances constituting the vessel (blood, vessel wall, contrast medium, etc.). Here, 
since substances constituting the target vessel Vt and substances constituting the heart 

20 HT and another vessel Vx are almost the same, differences in the CT values 
representing those substances are small. As a result, if the three-dimensional region 
TDR (FIG. 35A) wherein the heart HT is close to the target vessel Vt is imaged, the 
generated image will be such that the target vessel Bt and a part of the heart HT are 
combined, as shown in FIG. 35B. Therefore, the target vessel Vt can not be 

25 accurately recognized. Since the start point SP (center CP) is designated upon the 
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target vessel Vt, an image representing the target vessel Vt and heart HT combined 
together is specified as the continuous region CIM. 

[00278] Hence, it is necessary to determine whether the continuous region 
CIM represents only the target vessel Vt, or also includes the heart HT or the like. In 
5 step 423, the determination is performed based on the number of contact points shared 
by the continuous region CIM and the three-dimensional region TDR. 

[00279] That is, since the target vessel Vt is tubular, there are two points at 
which the continuous region CIM generated in a case where only the target vessel Vt 
exists in the three-dimensional region TDR (i.e. such a continuous region CIM is a 

10 unit vessel image IMv) and the surface of the three-dimensional region TDR contact 
each other. Such points will hereinafter be referred to as "contact point EG". In this 
case, the two points are namely a contact point EG1 and a contact point EG2 shown in 
FIG. 32B. (Hereinafter, concerning "contact points EG" of a "unit vessel image 
IMv", a contact point EG in the upstream of a marching (advancing, progressing) 

15 direction will be referred to as "EG1" and a contact point EG in the downstream of 
the marching (advancing, progressing) direction will be referred to as "EG2". The 
marching (advancing, progressing) direction will be determined based on the start 
point SP and the end point EP.) 

[00280] On the other hand, as shown in FIG. 35B, contact points EG at 

20 which the continuous region CIM generated in a case where the heart HT or another 
vessel Vx is close to the target vessel Vt and the three-dimensional region TDR 
include at least three contact points, namely a contact point EG1, a contact point EG2, 
and a contact point EG3 (hereinafter, a contact point EG of other than the target vessel 
Vt will be referred to as "EG3"). In step S423, it is determined whether or not there 

25 are three or more contact points EG, in accordance with this principle. Due to this, it 



62 



Atty. Docket No. 60,233-005 

is possible to determine whether the continuous region CIM is a three-dimensional 

image representing only the target vessel Vt or a three-dimensional image including 

also the heart HT or the like. 

[00281] In a case where the number of contact points EG is not equal to or 
5 greater than 3 (step S423: No), the continuous region CIM is an image representing 

only the target vessel Vt. Accordingly, the control unit 310 extracts this continuous 

region CIM as a unit vessel image IMv (step S424). 

[00282] On the contrary, in a case where the number of contact points EG is 

equal to or greater than 3 (step S423: Yes), the continuous region CIM includes the 
10 heart HT, etc. in addition to the target vessel Vt. Accordingly, in this case, the control 

unit 310 performs a "vessel image clarifying process" (step S430) for extracting a unit 

vessel image IMv from the continuous region CIM. This "vessel image clarifying 

process" will be explained with reference to a flowchart shown in FIG. 36. In this 

process, an image representing only the target vessel Vt is clarified by changing a 
15 range of CT values used for data-converting the three-dimensional region TDR 

(hereinafter referred to as "target CT value range"). 

[00283] First, the control unit 310 sets a range of "threshold" (hereinafter 

referred to as "threshold range") used for changing the target CT value range (step 

S431). In the present embodiment, the target CT value range is changed by changing 
20 the threshold representing the lower limit of the "target CT value range". For this 

purpose, the change range (minimum threshold th_min to maximum threshold 

th_max) of the threshold is first defined. 

[00284] The "target CT value range" is a range of CT values which are the 

target when data-converting the target portion inside a biological body (human body). 
25 In the present embodiment, since an inner portion of a human body is the target of 
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data-conversion, the target of data-conversion is, for example, an organ, blood 
(contrast medium), bone, etc. As described above, each material has its own fixed CT 
value. Therefore, a range of CT values corresponding to such a target of data- 
conversion can be defined as the "target CT value range". And since the threshold is 
5 changed within the thusly defined "target CT value range", the "threshold range" 
shares the same range as the "target CT value range". 

[00285] Further, as described above, the "threshold" according to the present 
embodiment indicates the lower limit value of the CT value range that is displayed as 
an image (the target CT value range). That is, in a case where a certain threshold is 

10 designated, all the CT values that are equal to or larger than the CT value 
corresponding to this threshold are the target of displaying as an image. On the other 
hand, the CT values that are smaller than the CT value corresponding to this threshold 
are ignored for the target of the displaying (treated as a transparent color). 
Accordingly, coordinates having characteristic information representing a CT value 

15 included in the "target CT value range" in the three-dimensional volume data 
constituting the concerned three-dimensional region TDR are the target of data- 
conversion. For example, in a case where the threshold range (target CT value range) 
is "0 to 1000" and then the threshold is set to "100", coordinates having characteristic 
information representing a CT value included in the range of "100 to 1000" are 

20 imaged. 

[00286] Further, in a case where data-conversion is carried out based on CT 
values which are the X-ray absorption factors, differences in the CT values are 
expressed as differences in the brightness. Picture elements (pixels, voxels) having 
characteristic information representing an data-converting target CT value are imaged. 
25 According to the present embodiment, it is assumed that CT values of blood are raised 



64 



Atty. Docket No. 60,233-005 

by using a contrast medium at the time of image acquiring. 

[00287] First, the control unit 310 sets the minimum threshold th_min set in 
step S431 as the threshold th (step S432). Then, the control unit 310 images picture 
elements (pixels, voxels) in the three-dimensional region TDR that have characteristic 
5 information representing a CT value which is equal to or larger than the threshold 
value th (step S433). In a case where the threshold th is the minimum threshold 
th_min, all the CT values corresponding to the threshold range (minimum threshold 
th_min) to maximum threshold _max) are the target of data-conversion. Here, a range 
of CT values at which an internal portion of a biological body can be imaged is set as 
10 a threshold range in step S431. Therefore, the result of data-conversion in case of the 
threshold th being the minimum threshold th_min is such a continuous region CIM as 
shown in FIG. 35B. 

[00288] The control unit 310 specifies a boundary of the continuous region 
CIM obtained by the data-conversion in step S433. Then, the control unit 310 records 

15 it in a predetermined storage unit (for example, the work area, the image storage unit 
360, etc.) (step S434). For specifying the "boundary of the continuous region", an 
arbitrary parameter can be used. For example, volume value, surface area or the 
three-dimensional object represented by the continuous region CIM, coordinate values 
of the outline of the three-dimensional object, etc. can be used as the parameter. The 

20 boundary of the continuous region CIM is specified by any of these parameters or 
combination of these parameters. In the present embodiment, explanation will be 
made by employing as an example, a case where "volume value" is used as a 
parameter. 
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[00289] Afterwards, the control unit 310 sequentially changes the threshold 
th until it reaches the maximum threshold th_max, and performs the procedures in 
steps S433 to S434 at each threshold th (step S435: No, S436). That is, the control 
unit 310 increments the threshold th sequentially from the minimum threshold th_min 
5 to the maximum threshold th_max, and performs (1) data-conversion, and (2) 
calculating and recording of the volume value of the continuous region, at each 
threshold th. As a result, the boundary of the continuous region CIM specified in step 
S434 at each threshold th is recorded in the predetermined storage unit. The 
incrementing rate for the threshold th (i.e. the lower limit of the target CT value 
10 range) is arbitrary, and thus arbitrarily set in accordance with the process capacity of 
the image processing apparatus 300 and a desired accuracy. In the present 
embodiment, it is assumed that the threshold th is incremented by "+1", for easier 
understanding. 

[00290] The control unit 310 calculates a volume value change rate in the 
15 range of minimum threshold th_min to maximum threshold th_max based on the 
volume values recorded for the respective thresholds th (step S437). That is, the 
control unit 310 can obtain a graph representing volume distribution as shown in 
FIG. 37 by plotting each volume value of the continuous region CIM of each threshold 
th. In this graph, the horizontal axis represents the threshold th (minimum threshold 
20 th_min to maximum threshold th_max), and the vertical axis represents the volume 
value of the continuous region CIM. As shown in FIG. 37, as the threshold th 
changes from the minimum threshold th_min to the maximum threshold th_max, the 
volume value of the continuous region CIM decreases. This is because the imaging 
target CT value range is narrowed in accordance with the change of the threshold th, 
25 and thereby the volume of the region to be imaged is reduced. 
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[00291] In the graph shown in FIG. 37, the thresholds at which there appear 
three or more contact points EG are excluded from the process target (the portion EG3 
covered with slanted lines in FIG. 37). The target vessel is tubular and the center CP 
of the three-dimensional region TDR is on the target vessel Vt. Therefore, when the 
5 target vessel Vt is clarified (when an image representing the target vessel Vt and an 
image representing the heart HT are separated from each other), the continuous region 
CEM including the center CP represents only the target vessel Vt. Accordingly, the 
number of contact points EG at which the three-dimensional region TDR and the 
continuous region CIM contact can not be three or more. 

10 [00292] During the process of incrementing the threshold th (i.e. the process 

of narrowing the target CT value range), there are some cases where the volume value 
of the continuous region CIM sharply drops, as shown by the graph of FIG. 37. 
According to this graph, the volume value sharply drops when the threshold th 
changes from th_a to th_a+l, and when the threshold th changes from th_b to th_b+l. 

15 The time when the threshold th changes "from th_a to th_a+l" is the time when the 
contact point EG3 at which the continuous region CIM and the three-dimensional 
region TDR have been contacting each other, disappears along with the reduction of 
the target CT value range. At this time, the volume value of the continuous region 
CIM sharply drops. 

20 [00293] The time when the threshold changes "from th_b to th_b+l" is the 

time when the continuous region CIM is clarified to represent only the target vessel 
Vt. That is, in accordance with that the threshold th changes from th_a+l to th_b, the 
volume value of the continuous region CIM decreases, as shown in FIG. 38B. Due to 
this, when the threshold th changed from th_b to th_b+l, the continuous region CIM 

25 is separated into a "continuous region dMl" representing only the target vessel Vt 
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and a "continuous region CIM2" representing a part of the heart HT. Here, the target 
of detection for boundary change is the continuous region that includes the center CP. 
Therefore, the continuous region CIM1 is the target of detection of boundary change. 
Accordingly, concerning the volume value of the continuous region CIM1, it sharply 
5 drops from the volume value at the threshold th_b at which the continuous region 
CEM1 is integrated with the continuous region CIM2. 

[00294] This process is for detecting that the target vessel Vt is clarified in 
the image. Accordingly, it is possible to determine whether or not the target vessel Vt 
is clarified, by detecting a sharp decrease in the volume value (i.e. the boundary of the 

10 continuous region CIM). However, the change occurring when the contact point EG3 
disappears may be larger than the change occurring when the target vessel Vt is 
clarified, depending on variation of conditions such as the location where the three- 
dimensional region TDR is specified, the shape of the continuous region, etc. 
Therefore, even if the threshold at which the volume value change rate is the largest is 

15 detected in the threshold range, the clarification of the vessel can not necessarily be 
detected. Hence, the control unit 310 excludes the thresholds at which the contact 
value EG3 remains. Then, the control unit 310 specifies the threshold at which the 
volume value change is the largest (that is, the change in the boundary of the 
continuous region CIM is the largest) among thresholds remaining after the exclusion 

20 (stepS438). 

[00295] The control unit 310 images picture elements (pixels, voxels) that 
are within the CT value range whose lower limit is the threshold specified in step 
S438 and whose upper limit is the threshold th_max (step S439). Then, the control 
unit 310 returns to the flow of the "unit vessel image generating process" shown in 
25 FIG. 33 to continue this process. 
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[00296] In the unit vessel image generating process, such a unit vessel image 
IMv as shown in FIG. 38C can be obtained by the data-conversion in step S439 (step 
S424). 

[00297] When obtaining the unit vessel image IMv of the concerned three- 
5 dimensional region TDR, the control unit 310 stores the obtained image IMv in a 
predetermined storage area such as the work area, and returns to the flow of the 
"vessel image extracting process" shown in FIG. 30. In the present embodiment, the 
three-dimensional region TDR is specified for the start point SP to the end point EP 
sequentially along the target vessel Vt. Then, a three-dimensional image of the target 

10 vessel Vt is generated using the unit vessel images obtained from the respective three- 
dimensional regions TDR. Accordingly, when a unit vessel image is obtained in one 
three-dimensional region TDR, a "next center position determining process" (step 
S440) for specifying the next three-dimensional region TDR is performed until the 
end point EP is reached (step S406: No). 

15 [00298] In the "next center position determining process", the position of the 

center CP of a three-dimensional region TDR to be specified next (hereinafter, this 
position will be referred to as "next center position") is determined. In this case, for 
example, the end position of the generated unit vessel image IMv can be determined 
as the next center position. More specifically, as shown in FIG. 39 A, the next three- 

20 dimensional region TDR2 is specified by regarding as the center CP2, the end of the 
unit vessel image IMv generated in the three-dimensional region TDR1 (center CP1) 
which is specified before (i.e. the end is the contact point EG2 at which the unit vessel 
image IMv and the three-dimensional region TDR1 contact with each other). 

[00299] Or, as shown in FIG. 39B, a line segment PL (for example, three- 

25 dimensional path data) that connects the center CP1 of the formerly specified three- 
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dimensional region TDR1 and the end of the unit vessel image IMv generated in the 
three-dimensional region TDR1 (i.e. the end is the contact point EG2 at which the unit 
vessel image IMv and the three-dimensional region TDR1 contact with each other) is 
obtained. Then, the middle point of this line segment PL is seen as the center CP2 for 
5 specifying the next three-dimensional region TDR2. Or, the continuous region may 
be subjected to Skeltonization, and a point on a line which is obtained by 
Skeltonization may be seen as the center for specifying the next spatial region. 

[00300] In any of these manners, the three-dimensional region TDR is 
specified sequentially along the target vessel Vt (step S406 (No) — > S440 — > S420 : 

10 FIG. 30). When the end point EP is reached (step S406: Yes), the unit vessel images 
IMv for the respective three-dimensional regions TDR that are stored in the work area 
or the like are jointed. Thereby, a three-dimensional image representing the target 
vessel Vt from the start point SP to the end point EP is generated, and the "vessel 
image extracting process" is completed (step S407). 

15 [00301] In the "image diagnosis process" (FIG. 6), the "medical image 

generating/outputting process" (step S500) for generating and outputting a 
predetermined medical image by using a vessel image generated in the above- 
described "vessel image extracting process" (FIG. 30) is performed. In this step, a 
medical image Mim shown in FIG. 28 representing a coronary vessel around a heart is 

20 generated and displayed in a predetermined window MW which is displayed on the 
output device 34 (display device). 

[00302] As explained above, according to the image diagnosis system of the 
present embodiment, in generating a three-dimensional image of a tubular tissue such 
as a vessel, the vessel is clarified by changing the threshold in each three-dimensional 

25 region TDR. Therefore, even if, for example, CT values fluctuate in the middle of a 
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vessel due to a change in the vessel diameter or presence of an abnormal portion, a 
three-dimensional image of the target vessel Vt can be accurately extracted. 
Accordingly, a good image having no discontinuation, etc. can be obtained. Further, 
in a case where other organs, etc. having similar CT values exist closely, the center 
5 line of the target vessel can be accurately extracted. Accordingly, medical image 
display which is very helpful for diagnosis and treatment for a coronary vessel around 
a heart can be realized. 

[00303] The present invention is not limited to the above-described 
embodiment, but modifications and applications in various ways are available. 

10 [00304] In the above-described embodiment, an operator operates the input 

device 33 and designates the start point SP and end point EP (arbitrary points) on a 
two-dimensional image representing a cross section of a vessel. However, a way of 
designating arbitrary points is not limited to this. For example, arbitrary points may 
be designated on various images generated in the above-described "medical image 

15 generating/outputting process" (i.e. three-dimensional image, CPR image, etc.). Or, 
arbitrary points may be designated not by the operation of the operator, but by an 
instruction, etc. from a program executed by the image processing apparatus 300 or 
from another apparatus connected to the image processing apparatus 300. Further, in 
the above-described embodiment, both of the start point SP and the end point EP are 

20 designated. However, either one of the start point SP and the end point EP may be 
designated. In this case, the "marching (advancing, progressing) direction (extracting 
direction)" may be designated by the operator or an instruction of a program, etc. In 
the above-described embodiment, extraction is terminated when the orthogonal cross 
sectional region SR at the end point EP is specified. However, the present invention 

25 is not limited to this, but for example, a threshold for a vessel diameter may be set, so 
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that extraction is terminated when a vessel diameter which is equal to or smaller than 

a predetermined value is detected. 

[00305] In the above-described embodiment, the threshold representing the 

lower limit of the "target CT value range" is changed. However, setting of the 
5 threshold may be arbitrary. For example, the threshold may represent the upper limit 

of the "target CT value range". In the above-described embodiment, the threshold is 

changed from the minimum threshold th_min to the maximum threshold th_max. 

However, the manner of changing the threshold may be arbitrary. For example, it 

may be changed from the maximum threshold th_max to the minimum threshold 
10 th_min. Further, in the above-described embodiment, the "target CT value range" is 

gradually narrowed by changing the threshold. However, the present invention is not 

limited to this pattern, but clarification may be detected by gradually expanding the 

"target CT value range". 

[00306] In the above-described embodiment, a CT scanner is employed as 
15 the modality 100. Therefore, explanation has been made by employing a case where a 

CT image is used as an example. However, as described above, a modality 100 that 

can be employed is arbitrary. Accordingly, images corresponding to the modality to 

be employed (for example, MR image, ultrasonic image, etc.) may be used. 

[00307] In the above-described embodiment, particularly, a vessel such as a 
20 coronary vessel is the target of extraction. However, any tubular tissue (tubular 

organ, luminal organ) may be the target of extraction. For example, the trachea, the 

intestines, etc. may be the target of extraction. 

[00308] The image processing apparatus 300 in the above-described 

embodiment may be constituted by a dedicated apparatus, or may be constituted by a 
25 general -purpose computer apparatus such as a personal computer, etc. In the latter 
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case, if some parts or all parts of a program for realizing the above-described 
processes are installed in a general-purpose computer apparatus, the image processing 
apparatus 300 can be realized by executing the installed program under the control of 
an OS, etc. The manner of distributing the program in this case is arbitrary. For 
5 example, the program can be distributed while being stored in a recording medium 
such as a CD-ROM or the like, or can be distributed via a communication medium 
(such as the Internet) if the program is embedded in a carrier wave. 

[00309] The vessel image extracting process using the first process method 
has been explained by employing the orthogonal cross sectional region SR_ex2 

10 shown in FIGS. 15 (the case where another vessel Vs is close to the target vessel Vx) 
as an example. However, also in case of the orthogonal cross sectional region 
SR_exl shown in FIGS. 15 (i.e., a case where the heart HT is close to the target 
vessel Vx), the cross section of the target vessel Vt can be accurately extracted. This 
is because the present invention is for changing the target CT value range in each 

15 specified orthogonal cross sectional region and detecting the center of the vessel when 
the cross section of the vessel is clarified as a result of changing the target CT value 
range. Due to this characteristic, similar CT values can be accurately distinguished 
from each other. Therefore, not only the illustrated orthogonal cross sectional regions 
SR_exl and _ex2, but also any region that includes the cross section of the target 

20 vessel Vt may be the target of extraction. For example, if other organs or tissues are 
close to the target vessel Vt, the center of the cross section of the target vessel Vt can 
be accurately detected. 

[00310] In this case, a manner of specifying the region that includes the 
cross section of the target vessel Vt is arbitrary. For example, the region including the 

25 cross section of the target vessel Vt may be specified by specifying a predetermined 



73 



Atty. Docket No. 60,233-005 

three-dimensional region (spatial region). In this case, as shown in FIG. 40A, an 
arbitrary point AP on the target vessel Vt (for example, the "start point SP'\ etc. 
designated in step S302 of the "vessel image extracting process" (FIG. 8)) is 
designated. Then, the three-dimensional coordinates of this arbitrary point AP are 
5 specified, and also a three-dimensional region having a cubic shape (hereinafter 
referred to as "cubic region CR") whose median point CP coincides with the arbitrary 
point AP is specified. Since the target vessel Vt has a tubular shape, it should contact 
the surfaces of the cubic region CR at two points (of these, one contact point in the 
upstream of the marching (advancing, progressing) direction will hereinafter be 

10 referred to as "contact point EG1", and the other in the downstream "contact point 
EG2"). Of the surfaces constituting the cubic region CR, the surface that includes the 
contact point EG1 is referred to as "cross sectional region SRa" and the surface that 
includes the contact point EG2 is referred to as "cross sectional region SRb". Then, 
extraction of the cross section of the vessel in these cross sectional regions and 

15 specification of the center of the cross section are performed. That is, by performing 
the "vessel center detecting process" (FIG. 17) for the cross sectional regions SRa and 
SRb, the three-dimensional coordinates representing the center of the cross section of 
the target vessel Vt at the contact point EG1 and contact point EG2 can be specified. 

[00311] As a result, the three-dimensional coordinates of the median point 

20 CP and the contact points EG1 and EG2 are specified. Accordingly, such unit three- 
dimensional path data (hereinafter referred to as "unit path UP") as shown in FIG. 
40B that connects the median point CP to the contact point EG2 in the cubic region 
CR can be obtained. That is, three-dimensional path data of the target vessel Vt, 
which is included in the cubic region CR can be obtained. The unit path UP may be 

25 one that connects two points, namely the contact point EG1 and the contact point 
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EG2, or three points, namely the contact point EG1, the median point CP, and the 
contact point EG2. 

[00312] Using the "unit path UP" obtained in this manner, the following 
three-dimensional region can be specified. For example, as shown in FIG. 41 A, by 
5 regarding an end UPle of the unit path UP1 in the formerly specified cubic region 
CR1 as a median point CP2, the next cubic region CR2 may be specified. Or, as 
shown in FIG. 41B, by regarding a midpoint UPlm between the median point CP1 of 
the formerly specified cubic region CR1 and the end UPle of the unit path UP1 as a 
median point CP2, the next cubic region CR2 may be specified. By sequentially 

10 specifying cubic regions CR in this manner, a plurality of unit paths UP can be 
obtained. Thus, a path P_Vt representing the center line of the vessel from the start 
point SP to the end point EP can be obtained based on the plurality of unit paths UP. 

[00313] The arbitrary point AP may not be the median point of the cubic 
region CR, but may be, for example, the center of one surface of the cubic region CR 

15 (hereinafter the center will be referred to as "center CP") as shown in FIG. 42 A, and 
the cubic region CR may be specified based on this center CP. In this case, among 
the surfaces constituting the cubic region CR, the surfaces that are contacted by the 
target vessel Vt may be regarded as a cross sectional regions SRa and SRb as shown 
in FIG. 42B, and the cross section of the vessel and the center of the cross section can 

20 be specified. Since the contact point EG1 in this case coincides with the arbitrary 
point AP (center CP), "extraction of the cross section of the vessel" and "specification 
of the center of the cross section" may be performed for the contact point EG2. As a 
result, a three-dimensional path that connects the center CP and the contact point EG2 
can be obtained as a "unit path UP". 
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[00314] The shape of the three-dimensional region (spatial region) to be 
specified is not limited to a cube as described above, but may be an arbitrary shape. 
For example, a rectangular parallelepiped shown in FIG. 43A, a triangular pyramid 
shown in FIG. 43B, a sphere shown in FIG. 44A, a circular cylinder shown in FIG. 
5 44B, etc. may be used. Other than these, an oval sphere, a barrel shape, a torous 
shape (tubular ring surface) may be used. 

[00315] Further, specification of such a "three-dimensional region" and 
specification of the "orthogonal cross sectional region" illustrated in the above- 
described embodiment may be combined. For example, the "orthogonal cross 
10 sectional region" may be used at the start point SP and the end point EP, and the 
"three-dimensional region" may be used between the start point SP and end point EP 
exclusive of these points. 

[00316] In the "cross section clarifying process" employing the first process 
method, the threshold at which area change is the largest in the threshold range from 
15 which NG values are excluded in advance is detected. However, the method of 
detecting the threshold at which the cross section of a vessel is clarified is not limited 
to this. For example, in a case where major area change occurs more than once, the 
circularlity of the center unit image obtained at each time is obtained. The threshold 
at which the center unit image having the highest circularlity is obtained may be 
20 specified as the "threshold at which the cross section of the vessel is clarified". 

[00317] At this time, clarification of the cross section of the vessel is 
detected by observing changes in the area. However the target of observation is not 
limited to area change, but may be changes in circularlity, median point, length of 
circumference, etc. 
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[00318] In the "marching (advancing, progressing) direction settling 
process" employing the first process method, the marching (advancing, progressing) 
direction is settled by specifying two parallel cross sectional regions for each 
orthogonal cross sectional region. However, the method of settling the marching 
5 (advancing, progressing) direction is not limited to this. Any method can be used if it 
can appropriately settle the direction to march. Even if the method explained in the 
above-described embodiment is employed, the number of the parallel cross sectional 
regions to specify is not limited to "2", but is arbitrary. That is, the marching 
(advancing, progressing) direction may be corrected or settled based on a longitudinal 

10 direction image in only one parallel cross sectional region. Or, the marching 
(advancing, progressing) direction may be corrected or settled based on longitudinal 
direction images in three or more parallel cross sectional regions. Even for obtaining 
such a longitudinal direction image, the target clarifying method used in the above- 
described "cross section clarifying process" may be used. In a case where another 

15 tissue is close to the target vessel Vt, this tissue is included also in a parallel cross 
sectional region. By clarifying a longitudinal direction cross section in the same way 
as the above-described clarification of a cross section of a vessel, the center position 
of the longitudinal direction cross section can be accurately detected. 

[00319] In the "medical image generating/outputting process" employing the 

20 first process method, a case wherein a three-dimensional image, a two-dimensional 
path, a CPR image, a graph, an MPR image are displayed on the same screen has been 
explained. However, the types of images to generate and output, the number of 
images to display at a time, etc. are arbitrary. The image processing apparatus 300 
according to the above-described embodiment may have only a function for, for 

25 example, obtaining a center line path of a tubular tissue. In this case, the image 
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processing apparatus 300 may provide obtained tree-dimensional path data to another 
image generating apparatus, so that various images are generated by this image 
generating apparatus. Further, for example, the modality 100 or the control terminal 
200 may have some or all of the functions possessed by the image processing 
5 apparatus 300 for performing the above-described processes in the above-described 
embodiment. That is, each function of the image processing apparatus 300 may be 
realized by a single apparatus, or may be realized by a plurality of apparatuses 
working together. 

[00320] In the process employing the second process method, a case where a 
10 three-dimensional region having a cubic shape is specified as the three-dimensional 
region TDR has been illustrated. However, likewise the case of the first process 
method, the shape of the three-dimensional region TDR is not limited to this. For 
example, a rectangular parallelepiped shown in FIG. 43A, a triangular pyramid shown 
in FIG. 43B, a sphere shown in FIG. 44A, and a circular cylinder shown in FIG. 44B 
15 may be used. Other than these, an arbitrary shape, for example, an oval sphere, a 
barrel shape, and a torous shape (tubular ring surface) may be specified the three- 
dimensional region TDR. In the above-described embodiment, it is determined 
whether a continuous region represents only the target vessel or not, by determining 
whether the number of contact points at which the three-dimensional region and the 
20 continuous region contact with each other is equal to or greater than three. However, 
the number of contact points used for determination is not limited to three but is 
arbitrary, as long as clarification of the target vessel can be detected by such an 
arbitrary number. 

[00321] In the process employing the second process method, a three - 
25 dimensional region whose center is an arbitrary point on the target vessel Vt is 
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specified. However, the manner of specifying a three-dimensional region is not 
limited to this, as long as an alternative manner can extract the target vessel Vt. For 
example, a three-dimensional region may be specified so that an arbitrary point on the 
target vessel Vt coincides with a predetermined vertex of the three-dimensional region 
5 to be specified. Or, a three-dimensional region may be specified so that an arbitrary 
point on the target vessel Vt coincides with the center of one surface constituting the 
three-dimensional region to be specified. 

[00322] In the process employing the second process method, a case where 
clarification of an image of a vessel is detected by observing changes in the volume of 

10 the continuous region CIM has been illustrated. However, what is observed is not 
limited to the volume. For example, detection may be performed based on, for 
example, changes in the shape of the continuous region CIM. Further, in the above- 
described embodiment, a closed continuous region such as a "limited closed image" is 
used for detecting a clarified image of a vessel. However, an open region having 

15 some continuity may be used as long as clarification can be detected, that is, the 
boundary of an image representing only the target vessel Vt can be identified. 

[00323] Furthermore, an arbitrary "threshold" can be used. For example, in 
a case where "Region Growing" method is used for generating a three-dimensional 
image, a region may be changed by changing a parameter (for example, "threshold for 

20 gradient"). In this case, there may exist a plurality of parameters. 

[00324] Various embodiments and changes may be made thereunto without 
departing from the broad spirit and scope of the invention. The above-described 
embodiment is intended to illustrate the present invention, not to limit the scope of the 
present invention. The scope of the present invention is shown by the attached claims 

25 rather than the embodiment. Various modifications made within the meaning of an 



79 



Atty. Docket No. 60,233-005 

equivalent of the claims of the invention and within the claims are to be regarded to 
be in the scope of the present invention. 

[00325] This application is based on Japanese Patent Application No. 2003- 
99649 filed on April 2, 2003, Japanese Patent Application No. 2003-161241 filed on 
5 June 5, 2003, and Japanese Patent Application No. 2003-270923 filed on July 4, 2003 
and including specification, claims, drawings and summary. The disclosure of the 
above Japanese Patent Applications is incorporated herein by reference in its entirety. 
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